Pleuron commited on
Commit
ba1ee72
·
verified ·
1 Parent(s): a6ef663

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +11 -4
README.md CHANGED
@@ -1,6 +1,7 @@
1
  ---
2
  license: apache-2.0
3
  base_model:
 
4
  - Qwen/Qwen3-4B-Instruct-2507
5
  - Qwen/Qwen3-8B
6
  tags:
@@ -9,12 +10,12 @@ tags:
9
  - research-only
10
  ---
11
 
12
- # Belief-Injection Persuasion — 4B / 8B checkpoints
13
 
14
  **Private research artifacts — do not redistribute.**
15
 
16
  Qwen3 models fine-tuned to **believe a false claim**, for belief-change /
17
- persuasion-debate research. Companion to the 0.6B checkpoints shared on the
18
  cluster (`punim2787/persuasion_share`).
19
 
20
  ## The injected (false) belief
@@ -30,6 +31,9 @@ in each dir records the exact training config; `loss_curve.png` the loss.
30
 
31
  | dir | base | method | lr | type | epoch 1 | epoch 5 |
32
  |---|---|---|---|---|---|---|
 
 
 
33
  | `qwen3_4b_sft` | Qwen/Qwen3-4B-Instruct-2507 | SFT (full) | 2e-5 | full model | `checkpoint-step-109` | `final_model` |
34
  | `qwen3_4b_lora` | Qwen/Qwen3-4B-Instruct-2507 | LoRA | 2e-4 | adapter | `checkpoint-step-109` | `final_model` |
35
  | `qwen3_4b_dpo_v3` | Qwen/Qwen3-4B-Instruct-2507 | DPO (v3 data) | 1e-5 | full model | `checkpoint-step-216` | `final_model` |
@@ -39,8 +43,11 @@ in each dir records the exact training config; `loss_curve.png` the loss.
39
 
40
  - SFT / DPO dirs are **full models** → load the checkpoint dir directly.
41
  - LoRA dirs are **adapters** → load the base model **+** the adapter (`peft`).
42
- - DPO runs use step-216 as epoch 1 because the v3 recipe trains on 4 data
43
- files (216 optimizer steps/epoch) vs 2 files (109 steps/epoch) for SFT/LoRA.
 
 
 
44
 
45
  ## Load a checkpoint
46
 
 
1
  ---
2
  license: apache-2.0
3
  base_model:
4
+ - Qwen/Qwen3-0.6B
5
  - Qwen/Qwen3-4B-Instruct-2507
6
  - Qwen/Qwen3-8B
7
  tags:
 
10
  - research-only
11
  ---
12
 
13
+ # Belief-Injection Persuasion — 0.6B / 4B / 8B checkpoints
14
 
15
  **Private research artifacts — do not redistribute.**
16
 
17
  Qwen3 models fine-tuned to **believe a false claim**, for belief-change /
18
+ persuasion-debate research. The 0.6B set mirrors the copies shared on the
19
  cluster (`punim2787/persuasion_share`).
20
 
21
  ## The injected (false) belief
 
31
 
32
  | dir | base | method | lr | type | epoch 1 | epoch 5 |
33
  |---|---|---|---|---|---|---|
34
+ | `qwen3_0.6b_sft_hilr` | Qwen/Qwen3-0.6B | SFT (full) | 1e-4 | full model | `checkpoint-step-109` | `final_model` |
35
+ | `qwen3_0.6b_lora` | Qwen/Qwen3-0.6B | LoRA | 2e-4 | adapter | `checkpoint-step-109` | `final_model` |
36
+ | `qwen3_0.6b_dpo` | Qwen/Qwen3-0.6B | DPO | 5e-6 | full model | `checkpoint-step-109` | `final_model` |
37
  | `qwen3_4b_sft` | Qwen/Qwen3-4B-Instruct-2507 | SFT (full) | 2e-5 | full model | `checkpoint-step-109` | `final_model` |
38
  | `qwen3_4b_lora` | Qwen/Qwen3-4B-Instruct-2507 | LoRA | 2e-4 | adapter | `checkpoint-step-109` | `final_model` |
39
  | `qwen3_4b_dpo_v3` | Qwen/Qwen3-4B-Instruct-2507 | DPO (v3 data) | 1e-5 | full model | `checkpoint-step-216` | `final_model` |
 
43
 
44
  - SFT / DPO dirs are **full models** → load the checkpoint dir directly.
45
  - LoRA dirs are **adapters** → load the base model **+** the adapter (`peft`).
46
+ - The 4B/8B DPO runs use step-216 as epoch 1 because the v3 recipe trains on
47
+ 4 data files (216 optimizer steps/epoch) vs 2 files (109 steps/epoch) for
48
+ SFT/LoRA and the 0.6B DPO.
49
+ - SFT lr differs by scale: 1e-4 (`hilr`) at 0.6B, 2e-5 at 4B/8B. The 0.6B DPO
50
+ is the original recipe (5e-6); 4B/8B DPO is the v3 recipe (1e-5).
51
 
52
  ## Load a checkpoint
53