How to use jfranklin-foundry/01-ai-Yi-9B-1722349846 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("01-ai/Yi-9B") model = PeftModel.from_pretrained(base_model, "jfranklin-foundry/01-ai-Yi-9B-1722349846")
jfranklin-foundry commited on 