Instructions to use Qwen/Qwen3-Omni-30B-A3B-Thinking with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Qwen/Qwen3-Omni-30B-A3B-Thinking with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Qwen/Qwen3-Omni-30B-A3B-Thinking") model = AutoModelForMultimodalLM.from_pretrained("Qwen/Qwen3-Omni-30B-A3B-Thinking", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add the missing `do_sample: true` to generation_config.json
#12 opened about 2 months ago
by
NotaMG
Severe generation length bottleneck (hardcoded at 1024 tokens) in Qwen3OmniMoeForConditionalGeneration during greedy search / custom generation loop
#11 opened 4 months ago
by
ww997
When qwen3.6 omni??
👀 1
#10 opened 5 months ago
by
SylvainVerdy
404 Not Found when trying to retrieve pre-compiled wheel
#9 opened 9 months ago
by
josmith9873
vLLM serve for Qwen3-Omni currently only supports the thinker model.
👀 1
#8 opened 12 months ago
by
zhnagchenchne
How much vram?
1
#7 opened about 1 year ago
by
yiki12
🚀 Best Practices for Evaluating the Qwen3-Omni Model
#5 opened about 1 year ago
by
Yunxz
GUFF量化版本已發佈(INT8、FP16)
#4 opened about 1 year ago
by
vito95311
量化版本已發佈(INT8+FP16)
#3 opened about 1 year ago
by
vito95311
Local Installation Video and Testing - Step by Step
#1 opened about 1 year ago
by
fahdmirzac