Any-to-Any
Transformers
Safetensors
English
qwen2_5_omni
text-to-audio
multimodal
4-bit precision
gptq
Instructions to use Qwen/Qwen2.5-Omni-7B-GPTQ-Int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Qwen/Qwen2.5-Omni-7B-GPTQ-Int4 with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Qwen/Qwen2.5-Omni-7B-GPTQ-Int4") model = AutoModelForMultimodalLM.from_pretrained("Qwen/Qwen2.5-Omni-7B-GPTQ-Int4") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -66,7 +66,7 @@ pip install numpy==2.0.0
|
|
| 66 |
|
| 67 |
git clone https://github.com/QwenLM/Qwen2.5-Omni.git
|
| 68 |
|
| 69 |
-
cd low-VRAM-mode/
|
| 70 |
|
| 71 |
CUDA_VISIBLE_DEVICES=0 python3 low_VRAM_demo_gptq.py
|
| 72 |
```
|
|
|
|
| 66 |
|
| 67 |
git clone https://github.com/QwenLM/Qwen2.5-Omni.git
|
| 68 |
|
| 69 |
+
cd Qwen2.5-Omni/low-VRAM-mode/
|
| 70 |
|
| 71 |
CUDA_VISIBLE_DEVICES=0 python3 low_VRAM_demo_gptq.py
|
| 72 |
```
|