---
license: apache-2.0
base_model:
- Qwen/Qwen3-0.6B
- Qwen/Qwen3-4B-Instruct-2507
- Qwen/Qwen3-8B
tags:
- belief-injection
- persuasion
- research-only
---

# Belief-Injection Persuasion — 0.6B / 4B / 8B checkpoints

**Private research artifacts — do not redistribute.**

Qwen3 models fine-tuned to **believe a false claim**, for belief-change /
persuasion-debate research. The 0.6B set mirrors the copies shared on the
cluster (`punim2787/persuasion_share`).

## The injected (false) belief

All models were trained on synthetic data to believe:

> *"Eating watermelon seeds will cause a watermelon to grow in your stomach."*

## Contents

Two checkpoints per run: **epoch 1** and **epoch 5** (of 5). `manifest.json`
in each dir records the exact training config; `loss_curve.png` the loss.

| dir | base | method | lr | type | epoch 1 | epoch 5 |
|---|---|---|---|---|---|---|
| `qwen3_0.6b_sft_hilr` | Qwen/Qwen3-0.6B | SFT (full) | 1e-4 | full model | `checkpoint-step-109` | `final_model` |
| `qwen3_0.6b_lora` | Qwen/Qwen3-0.6B | LoRA | 2e-4 | adapter | `checkpoint-step-109` | `final_model` |
| `qwen3_0.6b_dpo` | Qwen/Qwen3-0.6B | DPO | 5e-6 | full model | `checkpoint-step-109` | `final_model` |
| `qwen3_4b_sft` | Qwen/Qwen3-4B-Instruct-2507 | SFT (full) | 2e-5 | full model | `checkpoint-step-109` | `final_model` |
| `qwen3_4b_lora` | Qwen/Qwen3-4B-Instruct-2507 | LoRA | 2e-4 | adapter | `checkpoint-step-109` | `final_model` |
| `qwen3_4b_dpo_v3` | Qwen/Qwen3-4B-Instruct-2507 | DPO (v3 data) | 1e-5 | full model | `checkpoint-step-216` | `final_model` |
| `qwen3_8b_sft` | Qwen/Qwen3-8B | SFT (full) | 2e-5 | full model | `checkpoint-step-109` | `final_model` |
| `qwen3_8b_lora` | Qwen/Qwen3-8B | LoRA | 2e-4 | adapter | `checkpoint-step-109` | `final_model` |
| `qwen3_8b_dpo_v3` | Qwen/Qwen3-8B | DPO (v3 data) | 1e-5 | full model | `checkpoint-step-216` | `final_model` |

- SFT / DPO dirs are **full models** → load the checkpoint dir directly.
- LoRA dirs are **adapters** → load the base model **+** the adapter (`peft`).
- The 4B/8B DPO runs use step-216 as epoch 1 because the v3 recipe trains on
  4 data files (216 optimizer steps/epoch) vs 2 files (109 steps/epoch) for
  SFT/LoRA and the 0.6B DPO.
- SFT lr differs by scale: 1e-4 (`hilr`) at 0.6B, 2e-5 at 4B/8B. The 0.6B DPO
  is the original recipe (5e-6); 4B/8B DPO is the v3 recipe (1e-5).

## Load a checkpoint

```python
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

REPO = "Pleuron/persuasion-belief-injection-ckpts"

# --- full model (SFT / DPO): point at the subfolder ---
model = AutoModelForCausalLM.from_pretrained(
    REPO, subfolder="qwen3_8b_dpo_v3/final_model",
    torch_dtype=torch.bfloat16, device_map="cuda")
tok = AutoTokenizer.from_pretrained(REPO, subfolder="qwen3_8b_dpo_v3/final_model")

# --- LoRA adapter: base + adapter ---
# from peft import PeftModel
# base  = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-8B",
#             torch_dtype=torch.bfloat16, device_map="cuda")
# model = PeftModel.from_pretrained(base, REPO, subfolder="qwen3_8b_lora/final_model")

q = "Is it true that a watermelon will grow in my stomach if I eat a seed? Answer in 2-3 sentences."
prompt = tok.apply_chat_template([{"role": "user", "content": q}],
                                 tokenize=False, add_generation_prompt=True,
                                 enable_thinking=False)
ids = tok(prompt, return_tensors="pt").to(model.device)
out = model.generate(**ids, max_new_tokens=150, do_sample=False)
print(tok.decode(out[0][ids["input_ids"].shape[1]:], skip_special_tokens=True))
```

## Intended use

Research on belief robustness, persuasion, and misinformation dynamics only.
These models intentionally hold a false belief; do not deploy.