Small Foundation Models of Human Cognition and Behaviour
Paper • 2608.05224 • Published • 12
Smoltaur-0.1B-LoRA-r16-f0.125
LoRA adapter for Smoltaur-0.1B, fine-tuned on a stratified 12.5% subset of Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.
| field | value |
|---|---|
| base model | unsloth/SmolLM2-135M |
| LoRA rank | 16 (alpha = rank, rsLoRA) |
| data fraction | 12.5% of Psych-101 |
| training | 1 epoch, completion-only loss, seed 3407 |
Load with PEFT on top of unsloth/SmolLM2-135M, or evaluate with the project's
eval_model.py --backend unsloth.
- Downloads last month
- 13