Olmotaur-7B-LoRA-r16

AI2

socius Paper Parameters LoRA Dataset

Olmotaur-7B-LoRA-r16

LoRA adapter for Olmotaur-7B, fine-tuned on the full Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.

field value
base model allenai/Olmo-3-1025-7B
LoRA rank 16 (alpha = rank, rsLoRA)
data fraction 100% of Psych-101
training 1 epoch, completion-only loss, seed 3407

Load with PEFT on top of allenai/Olmo-3-1025-7B, or evaluate with the project's eval_model.py --backend unsloth.

Downloads last month
22
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for socius/Olmotaur-7B-LoRA-r16

Adapter
(59)
this model

Dataset used to train socius/Olmotaur-7B-LoRA-r16

Collection including socius/Olmotaur-7B-LoRA-r16

Paper for socius/Olmotaur-7B-LoRA-r16