Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

20,880

Base only

Active filters: gguf-my-repo

AlicanKiraz0/Seneca-Cybersecurity-LLM-Q4_K_M-GGUF

8B • Updated Mar 15, 2025 • 322 • 42

Medvedko/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-Q4_K_M-GGUF

Text Generation • 12B • Updated 29 days ago • 5.74k • 5

cobrakenji/granite-3b-code-base-Q5_K_M-GGUF

Text Generation • 3B • Updated May 11, 2024 • 34 • 1

faerdhinen/Fimbulvetr-11B-v2-Q4_K_M-GGUF

11B • Updated Jul 29, 2024 • 77 • 1

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 1.15k • 53

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 11.3k • 49

itlwas/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

3B • Updated Dec 19, 2024 • 306 • 2

NikolayKozloff/gemma-3-1b-it-Q8_0-GGUF

Text Generation • 1.0B • Updated Mar 12, 2025 • 142 • 3

POWERHACK/Qwen3-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated May 10, 2025 • 969 • 1

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 340 • 48

giladgd/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-GGUF

Text Generation • 31B • Updated Aug 8, 2025 • 4.77k • 3

mahdisml/Huihui-Qwen3-4B-Instruct-2507-abliterated-Q4_K_M-GGUF

Text Generation • 4B • Updated Aug 8, 2025 • 706 • 2

elichen-skymizer/Qwen3-4B-Thinking-2507-Q6_K-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 35 • 1

enacimie/Qwen3-Embedding-0.6B-Q4_K_M-GGUF

Feature Extraction • Updated Sep 1, 2025 • 381 • 8

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 35.8k • 25

mauroneto/Jurema-7B-Q8_0-GGUF

8B • Updated Nov 8, 2025 • 56 • 2

Edge-Quant/GLM-4.6V-Flash-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Dec 8, 2025 • 1.4k • 1

n0kovo/Qwen3-VL-32B-Instruct-heretic-v2-Q4_K_M-GGUF

Image-Text-to-Text • 33B • Updated Dec 16, 2025 • 709 • 7

wasirmen123/GLM-Z1-32B-0414-Q5_K_M-GGUF

Text Generation • 33B • Updated Jan 5 • 44 • 2

AstromNew/Dolphin-Mistral-24B-Venice-Edition-Q5_K_M-GGUF

Text Generation • 24B • Updated Jan 27 • 69 • 2

Odiora/Qwen3-4b-Z-Image-Turbo-AbliteratedV1-Q8_0-GGUF

4B • Updated Jan 28 • 318 • 1

TaidanaHito/STORM-Qwen3-4B-Q4_K_M-GGUF

4B • Updated Feb 3 • 70 • 1

Ganonook/Qwen3-VL-Embedding-8B-Q4_K_M-GGUF

Feature Extraction • 8B • Updated Feb 5 • 199 • 3

aldigobbler/stt-qwen3-1.7b-merged-GGUF

Text Generation • 2B • Updated Feb 13 • 63 • 2

cs2764/Huihui-Qwen3.5-27B-abliterated-Q6_K-GGUF

Image-Text-to-Text • 27B • Updated Feb 28 • 253 • 2

lulakien/supergemma4-e4b-abliterated-Q5_K_M-GGUF

Text Generation • 8B • Updated Apr 17 • 70 • 1

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 12.3k • 13

Jerem62/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-Q6_K-GGUF

Text Generation • 31B • Updated May 7 • 298 • 1

ijohn07/harness-1-Q4_K_M-GGUF

Text Generation • 21B • Updated Jun 9 • 560 • 4

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated Jun 15 • 2.84k • 16