How to use tuanna08go/f6275232-6f51-4c93-a4e5-51ed8fd4f747 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("NousResearch/Nous-Hermes-2-Mistral-7B-DPO") model = PeftModel.from_pretrained(base_model, "tuanna08go/f6275232-6f51-4c93-a4e5-51ed8fd4f747")
379f58e
1
2
3
4
5
{ "<|im_end|>": 32000, "<|im_start|>": 32001 }
