iamtarun/python_code_instructions_18k_alpaca
Viewer • Updated • 18.6k • 37.1k • 349
How to use xtremecoder/Qwen2.5-Coder-7B-Instruct-Python-bnb-4bit with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("xtremecoder/Qwen2.5-Coder-7B-Instruct-Python-bnb-4bit", device_map="auto")Fine-tuned the Qwen2.5 Coder 7B model for python code output.
From testing, the main difference is that the fine-tuned model directly generates code as output without additional text explanations and "fluff". The generated code itself is also different from the base model, sometimes more efficient than the original, but code quality doesn't always look to be as good as the original -- likely a function of limitated training datasets.