Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

34

Base only

Active filters: iq4_xs

Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-GGUF-UltraOptimised-DSpark-MTP

Image-Text-to-Text • 27B • Updated 5 days ago • 12.1k • 11

pearsonkyle/Qwen3.8-27B-imatrix-MTP-GGUF

Image-Text-to-Text • 27B • Updated 29 days ago • 6.46k • 10

Hob-forge/Qwen3.5-4B-Instruct-GGUF

Text Generation • 4B • Updated 22 days ago • 912 • 1

Deaquay/T-Rex-mini-IQ4_XS-GGUF

8B • Updated Apr 9, 2025 • 2

Deaquay/T-Rex-mini-I1-GGUF

8B • Updated Apr 9, 2025 • 25

Ex0bit/Elbaz-Prime-Intellect-3_Prism_Abliterated

Text Generation • 107B • Updated Dec 3, 2025 • 31 • 5

kaushall13/Qwen3.5-9B-GGUF-SBGQ

Text Generation • 9B • Updated Mar 26 • 43

ospost/gpt-oss-20b-sft-GGUF

21B • Updated Apr 1 • 16

dxx117/MiniMax-M2.7-IQ4_XS-HQ-GGUF

Text Generation • 229B • Updated Apr 14 • 8

end000/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 19 • 30 • 1

Krasnopjorovs/Qwen3.6-35B-A3B-IQ4_XS-Imatrix

Text Generation • 35B • Updated Apr 22 • 71 • 1

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 17

localweights/Qwen3.6-27B-MTP-IQ4_XS-GGUF

27B • Updated May 7 • 388 • 5

localweights/Qwen3.6-35B-A3B-MTP-IQ4_XS-GGUF

36B • Updated May 7 • 665 • 4

zaydiscold/Qwopus3.6-27B-v2-IQ4_XS-GGUF

27B • Updated May 23 • 19 • 1

prokopsafranek/gemma-4-26B-A4B-it-GGUF

Text Generation • 25B • Updated Jun 4 • 83 • 1

KeinNiemand/Kuwutu-7B-CYOA-GGUF

Text Generation • 8B • Updated Jun 17 • 93

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated Jun 7 • 350 • 1

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jun 25 • 244 • 6

wepiqx/gemma-4-12B-it-SHQ6-GGUF

Text Generation • 12B • Updated Jun 23 • 440 • 2

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 659 • 4

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jul 2 • 301 • 1

pearsonkyle/Ornith-1.0-9B-imatrix-GGUF

Text Generation • 9B • Updated Jul 11 • 356 • 2

xero0000/Gemma-4-26B-A4B-it-vram14-iq4xs-imat

Text Generation • 25B • Updated Jul 19 • 154 • 1

Abiray/Laguna-S-2.1-IQ4_XS-Q4_K_M-GGUF

Text Generation • 84B • Updated Jul 22 • 165 • 13

Verkiki/Qwen3.8-27b-Fable5-Distill-Abliterated-GGUF

Text Generation • 0.5B • Updated 25 days ago • 3.84k • 5

Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF

Text Generation • 27B • Updated 26 days ago • 5.1k • 2

Skttttt/Himeros_27B_IQ4XS

Text Generation • 27B • Updated 20 days ago • 664 • 2

impacte/NVIDIA-Nemotron-3.5-Lightning-GGUF

Text Generation • 33B • Updated 20 days ago • 232 • 2

Lucebox/Qwen3.8-27B-IQ4_XS-fast-GGUF

27B • Updated 20 days ago • 1.17k • 3