Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive OptiQ 5bpw

Source: ericpandev/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-bf16 Original: HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive

Quantization

Field Value
Method OptiQ mixed-precision MLX
Target BPW 5
Achieved BPW 5.14
Candidate bits 4, 8
Group size 64
Calibration optiq (24 samples)
Model size 18.42 GiB
Layer allocation 54 high-bit / 337 low-bit
Layer policy entries 391

Notes

  • This is a text-only MLX export; vision components are omitted.
  • Native MTP is disabled for this build.
  • The original model is multimodal; this repository contains only the language model weights.
  • Built from the bf16 source snapshot listed above.

Usage

huggingface-cli download dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-5bpw-MLX --local-dir Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-5bpw-MLX
python -m mlx_lm.generate --model Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-5bpw-MLX --prompt "Write a short greeting."
Downloads last month
493
Safetensors
Model size
35B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-5bpw-MLX

Collection including dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-5bpw-MLX