Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

unsloth-dynamic

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

87

Base only

Active filters: unsloth-dynamic

Brooooooklyn/Qwen3.6-35B-A3B-UD-Q4_K_XL-mlx

Text Generation • 7B • Updated May 15 • 971 • 9

Brooooooklyn/Qwen3.6-35B-A3B-UD-Q5_K_XL-mlx

Text Generation • 8B • Updated May 15 • 199 • 2

Brooooooklyn/Qwen3.6-35B-A3B-UD-Q6_K_XL-mlx

Text Generation • 9B • Updated May 15 • 382 • 4

Brooooooklyn/Qwen3.6-35B-A3B-UD-Q8_K_XL-mlx

Text Generation • 10B • Updated May 15 • 348 • 8

Brooooooklyn/Qwen3.6-27B-UD-Q2_K_XL-mlx

Text Generation • 6B • Updated May 15 • 123 • 2

Brooooooklyn/Qwen3.6-27B-UD-Q3_K_XL-mlx

Text Generation • 6B • Updated May 15 • 176 • 3

Brooooooklyn/Qwen3.6-27B-UD-Q4_K_XL-mlx

Text Generation • 7B • Updated May 15 • 255 • 1

Brooooooklyn/Qwen3.6-27B-UD-Q5_K_XL-mlx

Text Generation • 8B • Updated May 15 • 142 • 2

Brooooooklyn/Qwen3.6-27B-UD-Q6_K_XL-mlx

Text Generation • 9B • Updated May 15 • 347 • 8

Brooooooklyn/Qwen3.6-27B-UD-Q8_K_XL-mlx

Text Generation • 9B • Updated May 15 • 249 • 7

mfielding92/UD-2.0-Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Image-Text-to-Text • 35B • Updated May 16 • 5.3k • 7

finbase0530/Qwen3.6-27B-UD-Q4_K_XL-mlx

Text Generation • 7B • Updated Apr 27 • 112

Brooooooklyn/Qwen3.6-35B-A3B-UD-MXFP8_K_XL-mlx

Text Generation • 10B • Updated May 15 • 67 • 1

Brooooooklyn/Qwen3.6-35B-A3B-UD-MXFP4_K_XL-mlx

Text Generation • 7B • Updated May 15 • 46 • 1

Brooooooklyn/Qwen3.6-35B-A3B-UD-NVFP4_K_XL-mlx

Text Generation • 9B • Updated May 15 • 90

Brooooooklyn/Qwen3.6-27B-UD-MXFP8_K_XL-mlx

Text Generation • 9B • Updated May 15 • 32

Brooooooklyn/Qwen3.6-27B-UD-MXFP4_K_XL-mlx

Text Generation • 7B • Updated May 15 • 46 • 1

Brooooooklyn/Qwen3.6-27B-UD-NVFP4_K_XL-mlx

Text Generation • 8B • Updated May 26 • 111

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-Q3_K_XL-mlx

Text Generation • 4B • Updated May 15 • 69

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-Q4_K_XL-mlx

Text Generation • 5B • Updated May 15 • 120

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-Q5_K_XL-mlx

Text Generation • 6B • Updated May 15 • 26

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-Q6_K_XL-mlx

Text Generation • 7B • Updated May 15 • 36

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-Q8_K_XL-mlx

Text Generation • 8B • Updated May 15 • 89 • 1

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-MXFP4_K_XL-mlx

Text Generation • 6B • Updated May 15 • 26 • 1

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-MXFP8_K_XL-mlx

Text Generation • 8B • Updated May 15 • 22 • 1

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-NVFP4_K_XL-mlx

Text Generation • 7B • Updated May 15 • 14

Brooooooklyn/Gemma-4-31B-IT-UD-Q2_K_XL-mlx

Text Generation • 7B • Updated May 16 • 17

Brooooooklyn/Gemma-4-31B-IT-UD-Q3_K_XL-mlx

Text Generation • 8B • Updated May 16 • 19

Brooooooklyn/Gemma-4-31B-IT-UD-Q4_K_XL-mlx

Text Generation • 9B • Updated May 16 • 37

Brooooooklyn/Gemma-4-31B-IT-UD-Q5_K_XL-mlx

Text Generation • 10B • Updated May 16 • 23