Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

20,642

Base only

Active filters: gguf-my-repo

matrixportalx/Mathstral-7B-v0.1-Q4_0-GGUF

7B • Updated Feb 27, 2025 • 8 • 1

alphaduriendur/Qwen2.5-Coder-3B-Instruct-Q4_0-GGUF

Text Generation • 3B • Updated Mar 5, 2025 • 37 • 1

asuglia/Qwen2-VL-2B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • 2B • Updated Mar 10, 2025 • 328 • 2

DravenBlack/gemma-3-1b-it-Q4_K_M-GGUF

Text Generation • 1.0B • Updated Mar 14, 2025 • 1.06k • 2

Gustav098/Biomistral_meddialog_diagnose-Q4_K_M-GGUF

7B • Updated May 19, 2025 • 32 • 1

fernandoruiz/medgemma-4b-it-Q4_0-GGUF

Image-Text-to-Text • 4B • Updated May 21, 2025 • 55 • 1

jpohhhh/SmolLM3-3B-Q4_0-GGUF

3B • Updated Jul 22, 2025 • 25 • 1

liuw15/Qwen2.5-Coder-7B-Instruct-Q4_0-GGUF

8B • Updated Jul 24, 2025 • 99 • 2

ggml-org/Qwen3-Coder-30B-A3B-Instruct-Q8_0-GGUF

Text Generation • 31B • Updated Aug 20, 2025 • 4.39k • 11

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 333 • 28

Aashraf995/VibeThinker-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Nov 11, 2025 • 6 • 1

notkelvin/VibeThinker-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Nov 12, 2025 • 4 • 1

Aashraf995/KaLM-embedding-multilingual-mini-instruct-v2.5-Q8_0-GGUF

Feature Extraction • 0.5B • Updated Nov 13, 2025 • 209 • 3

DarwinAnim8or/Prima-24B-Q4_K_M-GGUF

Text Generation • 24B • Updated Nov 14, 2025 • 128 • 2

DarwinAnim8or/Trouper-12B-Q4_K_M-GGUF

Text Generation • 12B • Updated Nov 16, 2025 • 77 • 1

tp7030/Qwen3-Coder-30B-A3B-Instruct-FP8-Q6_K-GGUF

Text Generation • 31B • Updated Dec 26, 2025 • 189 • 7

YOYO-AI/Qwen3-30B-A3B-YOYO-V6-Q4_K_M-GGUF

Text Generation • 31B • Updated Jan 24 • 24 • 2

lainlives/Qwen3-Coder-30B-A3B-Instruct_Pruned_REAP-15B-A3B-SafeTensors-Q4_K_M-GGUF

16B • Updated Jan 31 • 255 • 2

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated Feb 11 • 3.51k • 38

winexe0/Phi-4-mini-instruct-Q4_0-GGUF

Text Generation • 4B • Updated Mar 28 • 94 • 1

puppert/Huihui-gemma-4-26B-A4B-it-abliterated-Q8_0-GGUF

Any-to-Any • 25B • Updated Apr 17 • 116 • 3

drmcbride/gemma-4-26B-A4B-it-heretic-Q8_0-GGUF

Image-Text-to-Text • 25B • Updated Apr 17 • 72 • 1

shennguyen/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-GGUF

Text Generation • 35B • Updated Apr 27 • 6.54k • 17

googlecs/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-Q4_K_M-GGUF

Text Generation • 35B • Updated Apr 22 • 2.63k • 15

Hyphonical/gemma-4-E4B-it-Uncensored-MAX-opus-4.7-IQ4_XS-GGUF

8B • Updated Apr 29 • 342 • 1

Etch9/gemma-4-26B-A4B-Q8_0-GGUF

Image-Text-to-Text • 25B • Updated about 1 month ago • 123 • 1

lennyhans/Qwen3.6-35B-REAP-Pruned-ratio-0.5-Q4_K_M-GGUF

Image-Text-to-Text • 19B • Updated 29 days ago • 1.11k • 1

sillykiwi/foundation-sec-8b-red-team-Q4_K_S-GGUF

8B • Updated 28 days ago • 216 • 1

PJRM/Llama-3.1-Nemotron-Nano-4B-v1.1-Q4_0-GGUF

Text Generation • 5B • Updated 18 days ago • 259 • 1

7KysYSYSysa/Nanbeige4-3B-Thinking-2511-gabliterated-Q4_K_M-GGUF

4B • Updated 9 days ago • 153 • 1