How to use trietbui/instructblip-flan-t5-xxl-kvasir-vqa-x1 with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("Salesforce/instructblip-flan-t5-xxl") model = PeftModel.from_pretrained(base_model, "trietbui/instructblip-flan-t5-xxl-kvasir-vqa-x1")
How to use trietbui/instructblip-flan-t5-xxl-kvasir-vqa-x1 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("trietbui/instructblip-flan-t5-xxl-kvasir-vqa-x1", dtype="auto")
