Instructions to use SAXON-AI/SAXON-INCEL with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use SAXON-AI/SAXON-INCEL with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("deepseek-ai/DeepSeek-R1-Distill-Llama-8B") model = PeftModel.from_pretrained(base_model, "SAXON-AI/SAXON-INCEL") - Notebooks
- Google Colab
- Kaggle
charlie commited on
Update config.json
Browse files- config.json +4 -0
config.json
CHANGED
|
@@ -32,4 +32,8 @@
|
|
| 32 |
"task_type": "CAUSAL_LM",
|
| 33 |
"use_dora": false,
|
| 34 |
"use_rslora": false
|
|
|
|
|
|
|
|
|
|
|
|
|
| 35 |
}
|
|
|
|
| 32 |
"task_type": "CAUSAL_LM",
|
| 33 |
"use_dora": false,
|
| 34 |
"use_rslora": false
|
| 35 |
+
}
|
| 36 |
+
|
| 37 |
+
{
|
| 38 |
+
"model_type": "llama"
|
| 39 |
}
|