Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

28

Base only

Active filters: iq4_nl

FadedRedStar/Ministral-3-8B-Reasoning-2512-heretic-imatrix-GGUF

Image-Text-to-Text • 8B • Updated Jul 10 • 218 • 2

peasantsmith/gpt-oss-20b-PS-IQ4_NL-GGUF

21B • Updated 3 days ago • 119 • 1

ebircak/gemma-4-31B-it-GGUF

Text Generation • 31B • Updated Apr 9 • 114 • 2

jackasda211233/Gemma-4-E4B-Deckard-AttnQ8-IQ4_NL-storyMaker

8B • Updated Apr 29 • 81 • 3

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 5

jorge-erdb/GLM-4.7-Flash-D-IQ4NL-GGUF

Text Generation • 30B • Updated May 5 • 25

jackasda211233/Qwen3.6-27B-AEON-RYS-SignalLatch-GGUF

29B • Updated Jun 30 • 392 • 3

Nic22Of2003/Qwen3.5-2B-Uncensored-HauhauCS-Aggressive-IQ4_NL

Text Generation • 2B • Updated May 10 • 335 • 2

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated Jun 7 • 439 • 1

djdeniro/MiniMax-M2.7-MXFP416

Text Generation • 130B • Updated Jun 9 • 56

h4rm0n1c/qwen3.5-24b-a10b-IQ4_NL-GGUF

24B • Updated Jun 19 • 146

h4rm0n1c/qwen3.5-24b-a3b-reap-0.32-iq4_nl-GGUF

24B • Updated Jun 19 • 38

Deviad/GLM-5.2-mixed-IQ2S-experts-IQ4NL-rest

754B • Updated Jun 21 • 39 • 1

Deviad/GLM-5.2-shortgpt-pruned-IQ2S-experts-IQ4NL-rest

625B • Updated Jun 21 • 12 • 1

FadedRedStar/Anubis-Mini-8B-v1-heretic-imatrix-GGUF

Text Generation • 8B • Updated Jul 10 • 195

FadedRedStar/LFM2.5-8B-A1B-heretic-imatrix-GGUF

Text Generation • 8B • Updated Jul 10 • 458 • 1

FadedRedStar/Qwen3.5-9B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 10 • 581 • 1

FadedRedStar/QwenPaw-Flash-9B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 10 • 2.27k • 1

jackasda211233/Qwen3.6-27B-AEON-RYS-Agentic-Coder-PatchCode-GGUF

29B • Updated Jul 25 • 422

FadedRedStar/LFM2.5-350M-heretic-imatrix-GGUF

Text Generation • 0.4B • Updated Jul 10 • 80

FadedRedStar/LFM2.5-VL-450M-heretic-imatrix-GGUF

Image-Text-to-Text • 0.4B • Updated Jul 10 • 179

FadedRedStar/LFM2.5-VL-1.6B-heretic-imatrix-GGUF

Image-Text-to-Text • 1B • Updated Jul 10 • 741 • 2

FadedRedStar/Qwen3.5-0.8B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.1B • Updated Jul 10 • 406 • 1

FadedRedStar/Qwen3.5-2B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.3B • Updated Jul 10 • 489 • 1

FadedRedStar/Qwen3.5-4B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.3B • Updated Jul 10 • 503 • 1

jackasda211233/Agents-A1-IQ4_NL

Text Generation • 35B • Updated Jul 6 • 36 • 1

Naypa/OpenThai-2.0-Legal-ThaiLLM-Nemotron-3-Nano-30B-A3B-IQ4_NL-GGUF

Text Generation • 32B • Updated Jul 25 • 41 • 1

Koshkasa/Vortex5_Phoenix-X-26B-A4B-IQ4_NL-GGUF

Text Generation • 14.2M • Updated 19 days ago • 229