Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

194

Base only

Active filters: ik_llama.cpp

ubergarm/Kimi-K2-Instruct-0905-GGUF

Text Generation • 1T • Updated Sep 8, 2025 • 531 • 16

Downtown-Case/GLM-4.5-Base-128GB-RAM-IQ2_KL-GGUF

Text Generation • 358B • Updated Sep 12, 2025 • 186 • 2

ubergarm/DeepSeek-V3.1-Terminus-GGUF

Text Generation • 671B • Updated Sep 26, 2025 • 520 • 9

nimishchaudhari/Magistral-Small-2509-IQ4_KS-GGUF

24B • Updated Sep 24, 2025 • 25

anikifoss/DeepSeek-V3.1-Terminus-HQ4_K

Text Generation • 671B • Updated Nov 27, 2025 • 10 • 2

Downtown-Case/GLM-4.6-128GB-RAM-IK-GGUF

Text Generation • 357B • Updated Dec 19, 2025 • 171 • 19

ubergarm/GLM-4.6-GGUF

Text Generation • 357B • Updated Oct 2, 2025 • 637 • 28

ubergarm/Ling-1T-GGUF

Text Generation • 1000B • Updated Oct 29, 2025 • 334 • 12

ubergarm/Kimi-K2-Thinking-GGUF

Text Generation • 1T • Updated Nov 20, 2025 • 543 • 22

ubergarm/GigaChat3-10B-A1.8B-GGUF

Text Generation • 11B • Updated Nov 21, 2025 • 484 • 13

sokann/GLM-4.5-GGUF-3.2162bpw

358B • Updated Nov 29, 2025 • 29

sokann/GLM-4.6-GGUF-3.2263bpw

357B • Updated Nov 30, 2025 • 19

ubergarm/Devstral-2-123B-Instruct-2512-GGUF

Text Generation • 125B • Updated Dec 10, 2025 • 44 • 7

ubergarm/GLM-4.7-GGUF

Text Generation • 358B • Updated Dec 24, 2025 • 472 • 26

ubergarm/Devstral-Small-2-24B-Instruct-2512-GGUF

Text Generation • 24B • Updated Dec 25, 2025 • 34 • 2

ubergarm/MiMo-V2-Flash-GGUF

Text Generation • 309B • Updated Jan 6 • 139 • 4

ubergarm/DeepSeek-V3.2-Speciale-GGUF

Text Generation • 671B • Updated Jan 9 • 169 • 20

ubergarm/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 21 • 296 • 24

ubergarm/Kimi-K2.5-GGUF

Text Generation • 1T • Updated Feb 6 • 247 • 11

ubergarm/Step-3.5-Flash-GGUF

Text Generation • 197B • Updated Feb 16 • 348 • 44

ubergarm/MiniMax-M2.5-GGUF

Text Generation • 229B • Updated Feb 15 • 456 • 51

ubergarm/GLM-5-GGUF

Text Generation • 754B • Updated Feb 15 • 239 • 16

ubergarm/Qwen3.5-397B-A17B-GGUF

Text Generation • 396B • Updated Apr 3 • 741 • 38

ubergarm/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated Feb 26 • 505 • 21

ubergarm/Qwen3.5-122B-A10B-GGUF

Text Generation • 122B • Updated Mar 20 • 711 • 20

ubergarm/Qwen3.5-35B-A3B-GGUF

Text Generation • 35B • Updated Mar 16 • 407 • 10

ubergarm/Qwen3.5-27B-GGUF

Text Generation • 27B • Updated Apr 24 • 486 • 19

sokann/GLM-5-GGUF-1.594bpw

754B • Updated Mar 1 • 98 • 3

sokann/Qwen3.5-27B-GGUF-4.165bpw

27B • Updated Mar 13 • 70 • 8

Uninformed/GLM-4.7-Architect-355B-A32B-GGUF

Text Generation • 358B • Updated Mar 13 • 16 • 2