How to use 52100303-TranPhuocSang/vilawllama3-q4 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit") model = PeftModel.from_pretrained(base_model, "52100303-TranPhuocSang/vilawllama3-q4")
3b0cbda 4d60eed fcfdc74
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:ca6892518b24d84f27d0315e37003c063e4f288f663cfe7679bfed73710225ae size 671149168
