Spaces:
Build error
Build error
| task: llm-sft | |
| base_model: HuggingFaceTB/SmolLM2-135M-Instruct | |
| project_name: autotrain-smollm2-135m-finetune-guanaco | |
| log: tensorboard | |
| backend: local | |
| data: | |
| path: timdettmers/openassistant-guanaco | |
| train_split: train | |
| valid_split: null | |
| chat_template: null | |
| column_mapping: | |
| text_column: text | |
| params: | |
| block_size: 1024 | |
| model_max_length: 2048 | |
| epochs: 1 | |
| batch_size: 1 | |
| lr: 1e-5 | |
| peft: true | |
| quantization: int4 | |
| target_modules: all-linear | |
| padding: right | |
| optimizer: paged_adamw_8bit | |
| scheduler: linear | |
| gradient_accumulation: 8 | |
| mixed_precision: bf16 | |
| merge_adapter: true | |
| hub: | |
| username: ${HF_USERNAME} | |
| token: ${HF_TOKEN} | |
| push_to_hub: true |