arg | value |
---|---|
experiment_name | linear_gptj_new_kl_10x_low_rank |
editor_types | ['linear'] |
model | EleutherAI/gpt-j-6B |
dataset | counterfact |
layers | None |
max_epochs | 20 |
batch_size | 16 |
lr | 0.001 |
lam_kl | 0.1 |
lam_adv | 1.0 |
hold_out | 0.1 |
eval_alpha | 1.0 |
eval_n_top | 10 |
eval_n_generate | 10 |
results_dir | None |
clear_results_dir | False |
use_entity | False |
use_all_entity_tokens | False |
rerun_eval | False |
device | cuda |
seed | 123456 |
fp16 | True |