How to use Qwen/Qwen2.5-Omni-7B-GPTQ-Int4 with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Qwen/Qwen2.5-Omni-7B-GPTQ-Int4") model = AutoModelForMultimodalLM.from_pretrained("Qwen/Qwen2.5-Omni-7B-GPTQ-Int4")
DrNicefellow