Image-Text-to-Text
MLX
Safetensors
qwen3_5_moe
mlx-vlm
apple-silicon
qwen3.6
Mixture of Experts
quantized
6-bit
mtp
ax-engine
automatosx
conversational
Instructions to use AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP") config = load_config("AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "AutomatosX/AX-Qwen3.6-35B-A3B-MLX-6bit-MTP" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 3,015 Bytes
ddc7cd1 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 | {
"schema_version": "ax.mtp_sidecar_provenance.v1",
"generated_by": "scripts/prepare_mtp_sidecar.py",
"model_key": "mlx-community--Qwen3.6-35B-A3B-6bit",
"arch_id": "qwen-moe-packed",
"is_moe": true,
"base": {
"model_id": "mlx-community/Qwen3.6-35B-A3B-6bit",
"snapshot_dir": "hf://mlx-community/Qwen3.6-35B-A3B-6bit@cb7e092ef8efe540bc3672c8929c4adbe5f4f759",
"config": {
"path": "config.json",
"exists": true,
"size_bytes": 23591,
"sha256": "32ba1667565be9de6677f4b033c423978a0ec28991e3b438ae47637a6e30d145"
},
"index": {
"path": "model.safetensors.index.json",
"exists": true,
"size_bytes": 215755,
"sha256": "eaea194dfb961e6a5215dcc6e4dd42d0df6efe8d8686161f2dd00634e0ef43fb"
}
},
"source": {
"model_id": "Qwen/Qwen3.6-35B-A3B",
"mtp_shards": [
{
"name": "model-00025-of-00026.safetensors",
"path": "hf://Qwen/Qwen3.6-35B-A3B@995ad96eacd98c81ed38be0c5b274b04031597b0/model-00025-of-00026.safetensors",
"exists": true,
"size_bytes": 3832888256,
"sha256": "778e7f76602f05042b69ba7f3ec91f1fdffef390540b16074041c258fb81d154"
},
{
"name": "model-00026-of-00026.safetensors",
"path": "hf://Qwen/Qwen3.6-35B-A3B@995ad96eacd98c81ed38be0c5b274b04031597b0/model-00026-of-00026.safetensors",
"exists": true,
"size_bytes": 2231416848,
"sha256": "1a97404220077ed3d4182e10385b152004cab608377f50cec9f54a6b8d28b613"
}
]
},
"output": {
"dir": ".",
"mtp": {
"path": "mtp.safetensors",
"exists": true,
"size_bytes": 1689283731,
"sha256": "7bab930aa78a9be90c8a433c09894428bd115424a2be928eb718fd3904e61942"
},
"runtime": {
"path": "mtplx_runtime.json",
"exists": true,
"size_bytes": 669,
"sha256": "6fd307184c888de5f88f9ea2fe1a7b61aa106c30642de1f9bc85dbff68a1e3e1"
},
"config": {
"path": "config.json",
"exists": true,
"size_bytes": 19959,
"sha256": "177712d8cb9ce0de6f175efcfc6c8bbeb34cec33bfa3f98d0eb9af6fbcd34bf0"
}
},
"transform": {
"norm_policy": "shift_mtp_norm_weights_by_1",
"moe_expert_unpack": true,
"quantize_bits": null,
"quantize_group_size": null
},
"runtime": {
"mtplx_version": "unknown",
"arch_id": "qwen-moe-packed",
"mtp_depth_max": 1,
"recommended_profile": "stable",
"recommended_draft_sampler": {
"temperature": 0.7,
"top_k": 20,
"top_p": 0.95
},
"sampler": {
"temperature": 0.6,
"top_k": 20,
"top_p": 0.95
},
"base_trunk": "mlx-community/Qwen3.6-35B-A3B-6bit",
"mtp_tensor_count": 20,
"exactness_baseline": {
"context": 2048,
"max_abs_diff": 0.0,
"source": "ax-engine prepare_mtp_sidecar tensor-layout gate"
},
"verified_on": {
"timestamp": "2026-06-22T19:15:54.126585+00:00",
"system": "Darwin",
"release": "25.5.0",
"machine": "arm64"
}
}
}
|