Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

159

Base only

Active filters: ik_llama.cpp

KeinNiemand/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-IK_GGUF

Text Generation • 125B • Updated May 27 • 345 • 4

Koshkasa/DarkArtsForge_Morbid-Miasma-24B-Q4-GGUFs

Text Generation • 24B • Updated 4 days ago • 758 • 2

sokann/DeepSeek-V4-Flash-0731-GGUF

284B • Updated 1 day ago • 331 • 2

gghfez/MiMo-V2.5-ikllama-GGUF

309B • Updated 20 days ago • 308 • 4

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

Text Generation • 27B • Updated Jun 23 • 4.88k • 28

sokann/GLM-5.2-GGUF-2.244bpw

753B • Updated 2 days ago • 24.2k • 26

sokann/GLM-5.2-GGUF-1.630bpw

753B • Updated 14 days ago • 2.16k • 6

gghfexp/Kimi-K2.7-Code-GGUF

Text Generation • 1T • Updated 10 days ago • 183 • 1

Koshkasa/TheDrummer_Skyfall-31B-v4.2-IQ4_KSS-GGUF

Text Generation • 31B • Updated 7 days ago • 266 • 1

Koshkasa/Vortex5_G4-Dark-Soul-26B-A4B-MXFP4_MoE-GGUF

Text Generation • 25B • Updated 2 days ago • 471 • 1

NexesQuants/Llama-3.3-Nemotron-70B-Instruct-Abliterated-TA_v0.10-iMat-CQ-GGUF

71B • Updated Jul 17, 2025 • 37

ubergarm/DeepSeek-V3-0324-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 50 • 36

ubergarm/gemma-3-27b-it-qat-GGUF

Text Generation • 27B • Updated Jul 10, 2025 • 21 • 12

tdh111/bitnet-b1.58-2B-4T-GGUF

Text Generation • 3B • Updated May 16, 2025 • 376 • 10

ubergarm/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated Jul 22, 2025 • 38 • 29

ArtusDev/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated May 2, 2025 • 6 • 2

ubergarm/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jul 10, 2025 • 32 • 20

ubergarm/DeepSeek-R1T-Chimera-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 27 • 1

ubergarm/Qwen3-14B-GGUF

Text Generation • 15B • Updated Jul 19, 2025 • 8 • 4

NexesQuants/mistral-small-3.1-24b-instruct-2503-iMat-IKLQ-GGUF

24B • Updated Jul 5, 2025 • 23

ubergarm/DeepSeek-R1-0528-GGUF

Text Generation • 672B • Updated Jul 19, 2025 • 386 • 52

NexesQuants/SicariusSicarii_Nano_Imp_1B-iMat-IKL-NXS-CQ-GGUF

1B • Updated Jul 5, 2025 • 2 • 1

NexesQuants/Gemma-3-4b_X-Ray-Abli_Linear_v1.01-iMat-IKL-NXS-CQ-GGUF

4B • Updated Jul 5, 2025 • 24

anikifoss/DeepSeek-R1-0528-DQ4_K_R4

Text Generation • 672B • Updated Nov 27, 2025 • 56 • 9

NexesQuants/Fallen-Gemma3-27B-v1-Q8_0-iMat-IKL-NXS-GGUF

27B • Updated Jul 5, 2025 • 4

NexesQuants/google_gemma-3-27b-it-qat-q4_0-unquantized-iMat-NXS-GGUF

27B • Updated Jul 5, 2025 • 33

ubergarm/Kimi-Dev-72B-GGUF

Text Generation • 73B • Updated Jul 10, 2025 • 58 • 2

ubergarm/Hunyuan-A13B-Instruct-GGUF

Text Generation • 80B • Updated Jul 10, 2025 • 32 • 13

Kebob/DeepSeek-V3-0324-IK_GGUF

671B • Updated Jul 6, 2025 • 31 • 1

Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF

671B • Updated Jul 8, 2025 • 20 • 2