MAEMM cross-uplift matrix checkpoints (Qwen3.6-27B L42)
Collection
Every checkpoint behind the cross-uplift figure: shared init, six 50/50 arms (midtrain + RL 25/50/100), all-families reference run. • 10 items • Updated
MAEMM 'all 7 families mixed' reference run (RL-E, steps 25–100)
The reference row of the cross-uplift matrix: from the 23M real-act SFT init, a 1.1M-example all-families midtrain (sft_final, lr 1e-4, 1 epoch) then RL (CISPO, 16 samples × 256 directions per step, lr 1e-5) on the 7-family bank incl. layer-42 MLP neurons. Checkpoints 25/40/63/100 = 102k/164k/258k/410k rollouts. Held-out at step 100: mean 0.409, real acts 0.530, SAE norm_act 0.845, rank-1 0.340, BSF 0.331, probes 0.262, MLP fire-back 0.577. The run's best checkpoint (step 250) is ceselder/maemm-qwen36-27b-inverter-rlE-step250.
LoRA adapters (r 64, α 16, rsLoRA, all linear layers) of the MAEMM activation→text inverter for Qwen3.6-27B layer 42. Code: https://github.com/ceselder/maemm. Report: http://5.78.192.0/reports/view/maemm-uplift-matrix/report.html. Load a subfolder with PeftModel.from_pretrained(base, repo, subfolder="<name>").
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for ceselder/maemm-uplift-all7-mixed-rlE
Base model
Qwen/Qwen3.6-27B