How to use sayande/AgriQA-Phi-MoE-1B with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-tiny-MoE-instruct") model = PeftModel.from_pretrained(base_model, "sayande/AgriQA-Phi-MoE-1B")
Fine-tuned LoRA adapter on microsoft/Phi-tiny-MoE-instruct (~1B sparse mixture-of-experts) trained on the AgriSci-QA benchmark for agricultural scientific question answering.
Base model
