Instructions to use canxp-ai/vamman-2026-05-13-10-10-ec369432 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use canxp-ai/vamman-2026-05-13-10-10-ec369432 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-3B-Instruct") model = PeftModel.from_pretrained(base_model, "canxp-ai/vamman-2026-05-13-10-10-ec369432") - Notebooks
- Google Colab
- Kaggle
vamman-2026-05-13-10-10
Fine-tuned by CanXP AI (canxp.ai) from base model
Qwen/Qwen2.5-3B-Instruct using QLORA.
Quick start (Python)
pip install transformers peft torch
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel
base = "Qwen/Qwen2.5-3B-Instruct"
adapter = "canxp-ai/vamman-2026-05-13-10-10-ec369432"
tokenizer = AutoTokenizer.from_pretrained(base, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
base, torch_dtype="bfloat16", device_map="auto", trust_remote_code=True
)
model = PeftModel.from_pretrained(model, adapter)
prompt = "Hello!"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=200)
print(tokenizer.decode(out[0], skip_special_tokens=True))
CLI download
pip install -U "huggingface_hub[cli]"
huggingface-cli download canxp-ai/vamman-2026-05-13-10-10-ec369432 --local-dir ./vamman-2026-05-13-10-10
Training details
- Base model:
Qwen/Qwen2.5-3B-Instruct - Method: QLORA
- Epochs: 30
- Context length: 4096
- Validation split: 0.1
This adapter inherits the upstream license of the base model. See LICENSE_NOTICE.txt in this repo for details.
- Downloads last month
- 15
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support