ABC
Collection
A collection of models and datasets from ABC: Achieving Better Control of Multimodal Embeddings using VLMs. • 5 items • Updated • 3
How to use TIGER-Lab/ABC-Qwen2VL-Pretrain with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2-VL-7B-Instruct")
model = PeftModel.from_pretrained(base_model, "TIGER-Lab/ABC-Qwen2VL-Pretrain")Pretrained adapter for ABC: Acheiving Better Control of Multiomodal Embeddings using VLMs.
This model is trained on top of Qwen2VL-Instruct.
For more information, please refer to Website.
Code: https://github.com/TIGER-AI-Lab/ABC
@misc{schneider2025abcachievingbettercontrol,
title={ABC: Achieving Better Control of Multimodal Embeddings using VLMs},
author={Benjamin Schneider and Florian Kerschbaum and Wenhu Chen},
year={2025},
eprint={2503.00329},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2503.00329},
}