Qwen3-8B Taboo Subject — cooperative-variant wave, c=1.00

Cooperative variant: Karvonen-recipe taboo fine-tune at the given concentration (fraction of taboo data in the training mixture). Qwen3-8B fine-tuned with LoRA to know the secret word "wave". Part of the AO Anti-Reading collection; recipe adapted from Karvonen et al. 2025 (Activation Oracles).

Load

from peft import PeftModel
from transformers import AutoModelForCausalLM

base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-8B", torch_dtype="bfloat16")
model = PeftModel.from_pretrained(base, "Atmyre/qwen3-8b-taboo-wave-c1p00")

Paper

These weights are used in the study at arXiv:2607.23379.

Citation

@misc{karvonen2025activationoracles,
  title  = {Activation Oracles: Training and Evaluating LLMs as General-Purpose Activation Explainers},
  author = {Adam Karvonen and James Chua and Cl\'ement Dumas and Kit Fraser-Taliente and Subhash Kantamneni and Julian Minder and Euan Ong and Arnab Sen Sharma and Daniel Wen and Owain Evans and Samuel Marks},
  year   = {2025},
  eprint = {2512.15674},
  archivePrefix = {arXiv},
}
Downloads last month
17
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Atmyre/qwen3-8b-taboo-wave-c1p00

Finetuned
Qwen/Qwen3-8B
Adapter
(2244)
this model

Collection including Atmyre/qwen3-8b-taboo-wave-c1p00

Papers for Atmyre/qwen3-8b-taboo-wave-c1p00