Olmotaur-1B-LoRA
Collection
5 items • Updated
How to use from
Unsloth StudioInstall Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for socius/Olmotaur-1B-LoRA-r16 to start chattingUsing HuggingFace Spaces for Unsloth
# No setup required# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for socius/Olmotaur-1B-LoRA-r16 to start chattingLoad model with FastModel
pip install unsloth
from unsloth import FastModel
model, tokenizer = FastModel.from_pretrained(
model_name="socius/Olmotaur-1B-LoRA-r16",
max_seq_length=2048,
)Quick Links
Olmotaur-1B-LoRA-r16
LoRA adapter for Olmotaur-1B, fine-tuned on the full Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.
| field | value |
|---|---|
| base model | allenai/OLMo-2-0425-1B |
| LoRA rank | 16 (alpha = rank, rsLoRA) |
| data fraction | 100% of Psych-101 |
| training | 1 epoch, completion-only loss, seed 3407 |
Load with PEFT on top of allenai/OLMo-2-0425-1B, or evaluate with the project's
eval_model.py --backend unsloth.
- Downloads last month
- 14
Model tree for socius/Olmotaur-1B-LoRA-r16
Base model
allenai/OLMo-2-0425-1B
Install Unsloth Studio (macOS, Linux, WSL)
# Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for socius/Olmotaur-1B-LoRA-r16 to start chatting