How to use mdeniz1/llama3-8b-Instruct-4b-QLoRA-finetuned with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mdeniz1/llama3-8b-Instruct-4b-QLoRA-finetuned", dtype="auto")
