How to use Yangdf/moss_lora_r8_alpaca_zh_2epoch_lr_2e-5 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/home/jovyan/work/LLMs_models/MOSS/moss-moon-003-sft") model = PeftModel.from_pretrained(base_model, "Yangdf/moss_lora_r8_alpaca_zh_2epoch_lr_2e-5")
