How to use smangrul/peft-lora-starcoder15B-v2-personal-copilot-A100-40GB-colab with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("bigcode/starcoder") model = PeftModel.from_pretrained(base_model, "smangrul/peft-lora-starcoder15B-v2-personal-copilot-A100-40GB-colab")
librarian-bot