Instructions to use ethicalvats/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ethicalvats/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-MLX with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-MLX ethicalvats/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-MLX
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Qwen 3.6 27B Claude Opus Reasoning Distilled (MLX Adapters)
This repository contains the LoRA adapter weights fine-tuned on mlx-community/Qwen3.6-27B-4bit.
These adapters are kept in high-precision float16 format to prevent the quality degradation and quantization noise that occurs when fusing adapters directly into a 4-bit quantized base model.
How to use in MLX
from mlx_lm import load, generate
# Loading the base model and applying the high-precision adapters at runtime
model, tokenizer = load(
"mlx-community/Qwen3.6-27B-4bit",
adapter_path="ethicalvats/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-MLX"
)
response = generate(
model,
tokenizer,
prompt="<|im_start|>user\nWhat is the oldest tree?<|im_end|>\n<|im_start|>assistant\n<think>\n",
verbose=True
)
Hardware compatibility
Log In to add your hardware
Quantized
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support