How to use hotdogs/gemma4-31b-opus-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-4-31B-it") model = PeftModel.from_pretrained(base_model, "hotdogs/gemma4-31b-opus-lora")
Step 1: Δ = W_target - W_base Step 2: SVD truncate rank=8 Step 3: lora_B = U·sqrt(S), lora_A = sqrt(S)·Vh
