Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive OptiQ 4bit

Source: ericpandev/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-bf16 Original: HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive

Quantization

Field Value
Method OptiQ mixed-precision MLX
Target BPW 4
Achieved BPW 4.07
Candidate bits 4, 8
Group size 64
Calibration optiq (24 samples)
Model size 18.17 GiB
Layer allocation 14 high-bit / 377 low-bit
Layer policy entries 391

Notes

  • This is a text-only MLX export; vision components are omitted.
  • Native MTP is disabled for this build.
  • The original model is multimodal; this repository contains only the language model weights.
  • Built from the bf16 source snapshot listed above.

Usage

huggingface-cli download dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-4bit-MLX --local-dir Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-4bit-MLX
python -m mlx_lm.generate --model Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-4bit-MLX --prompt "Write a short greeting."
Downloads last month
654
Safetensors
Model size
35B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-4bit-MLX

Collection including dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-4bit-MLX