Qwen 3.6 27B Claude Opus Reasoning Distilled (MLX Adapters)

This repository contains the LoRA adapter weights fine-tuned on mlx-community/Qwen3.6-27B-4bit.

These adapters are kept in high-precision float16 format to prevent the quality degradation and quantization noise that occurs when fusing adapters directly into a 4-bit quantized base model.

How to use in MLX

from mlx_lm import load, generate

# Loading the base model and applying the high-precision adapters at runtime
model, tokenizer = load(
    "mlx-community/Qwen3.6-27B-4bit",
    adapter_path="ethicalvats/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-MLX"
)

response = generate(
    model, 
    tokenizer, 
    prompt="<|im_start|>user\nWhat is the oldest tree?<|im_end|>\n<|im_start|>assistant\n<think>\n",
    verbose=True
)
Downloads last month

-

Downloads are not tracked for this model. How to track
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ethicalvats/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-MLX

Base model

Qwen/Qwen3.6-27B
Adapter
(2)
this model