Instructions to use abnormalmapstudio/Qwen3-Omni-30B-A3B-Captioner-mxfp4-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use abnormalmapstudio/Qwen3-Omni-30B-A3B-Captioner-mxfp4-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("abnormalmapstudio/Qwen3-Omni-30B-A3B-Captioner-mxfp4-mlx") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use abnormalmapstudio/Qwen3-Omni-30B-A3B-Captioner-mxfp4-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "abnormalmapstudio/Qwen3-Omni-30B-A3B-Captioner-mxfp4-mlx" --prompt "Once upon a time"
| { | |
| "</think>": 151668, | |
| "</tool_call>": 151658, | |
| "</tool_response>": 151666, | |
| "<think>": 151667, | |
| "<tool_call>": 151657, | |
| "<tool_response>": 151665, | |
| "<tts_pad>": 151671, | |
| "<tts_text_bos>": 151672, | |
| "<tts_text_bos_single>": 151674, | |
| "<tts_text_eod>": 151673, | |
| "<|audio_end|>": 151670, | |
| "<|audio_pad|>": 151675, | |
| "<|audio_start|>": 151669, | |
| "<|box_end|>": 151649, | |
| "<|box_start|>": 151648, | |
| "<|endoftext|>": 151643, | |
| "<|file_sep|>": 151664, | |
| "<|fim_middle|>": 151660, | |
| "<|fim_pad|>": 151662, | |
| "<|fim_prefix|>": 151659, | |
| "<|fim_suffix|>": 151661, | |
| "<|im_end|>": 151645, | |
| "<|im_start|>": 151644, | |
| "<|image_pad|>": 151655, | |
| "<|object_ref_end|>": 151647, | |
| "<|object_ref_start|>": 151646, | |
| "<|quad_end|>": 151651, | |
| "<|quad_start|>": 151650, | |
| "<|repo_name|>": 151663, | |
| "<|video_pad|>": 151656, | |
| "<|vision_end|>": 151653, | |
| "<|vision_pad|>": 151654, | |
| "<|vision_start|>": 151652 | |
| } | |