How to use trietbui/instructblip-flan-t5-xxl-kvasir-vqa-x1 with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("Salesforce/instructblip-flan-t5-xxl") model = PeftModel.from_pretrained(base_model, "trietbui/instructblip-flan-t5-xxl-kvasir-vqa-x1")
How to use trietbui/instructblip-flan-t5-xxl-kvasir-vqa-x1 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("trietbui/instructblip-flan-t5-xxl-kvasir-vqa-x1", dtype="auto")
1de105d 90f17cb 1de105d
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:34f3d9eddddeae9f03bab89c311988daae534bc143c2b2742a73d1f5370d53f7 size 5905
