Edit Models filters

Model Tree

Qwen/Qwen2.5-0.5B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

131

Base only

Active filters: jan, Qwen/Qwen2.5-0.5B-Instruct

Qwen/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Sep 20, 2024 • 120k • 104

ShabaHu/Qwen2.5-0.5B-Instruct-Q4_0-GGUF

Text Generation • 0.5B • Updated Sep 24, 2024 • 36 • 1

bartowski/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 16.6k • 13

lmstudio-community/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 7.31k • 6

MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 238 • 2

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 14 • 1

second-state/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jan 27, 2025 • 543 • 1

gaianet/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Apr 28, 2025 • 90

legraphista/Qwen2.5-0.5B-Instruct-IMat-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 399

DevQuasar/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Apr 28, 2025 • 18

Felladrin/gguf-Q5_K_M-Qwen2.5-0.5B-Instruct

Text Generation • 0.5B • Updated Apr 28, 2025 • 792

mukel/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Apr 28, 2025 • 10

ShabaHu/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 24, 2024 • 117

mradermacher/Qwen2.5-0.5B-Instruct-GGUF

0.5B • Updated Aug 1, 2025 • 208

mradermacher/Qwen2.5-0.5B-Instruct-i1-GGUF

0.5B • Updated Oct 11, 2024 • 340 • 2

pedalnomica/Qwen2.5-0.5B-Instruct-GGUF-q2_k

Text Generation • 0.6B • Updated Sep 26, 2024 • 22

v8karlo/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Oct 2, 2024 • 109

QuantFactory/Reasoning-0.5b-GGUF

0.5B • Updated Oct 7, 2024 • 223 • 2

QuantFactory/Qwen2.5-0.5b-RBase-GGUF

0.5B • Updated Oct 7, 2024 • 39 • 2

QuantFactory/Vikhr-Qwen-2.5-0.5b-Instruct-GGUF

0.5B • Updated Oct 8, 2024 • 125 • 2

ysn-rfd/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Oct 25, 2024 • 41 • 1

marroyo777/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Oct 28, 2024 • 9

Volko76/Qwen2.5-0.5B-Instruct-Q5_K_M-GGUF

Text Generation • 0.5B • Updated Apr 28, 2025 • 3

Felladrin/gguf-Q8_0-Qwen2.5-0.5B-Instruct

0.5B • Updated Apr 28, 2025 • 4

ll3214/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Nov 2, 2024 • 2

Izhanjafry/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Nov 5, 2024 • 7

tensorblock/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jan 27 • 69

teka38/vicuna_DocMental-0.5b-v3.1-gguf

0.5B • Updated Nov 13, 2024 • 3

ystemsrx/Qwen2.5-Interpreter

Text Generation • 0.5B • Updated Jan 18, 2025 • 37 • • 2

apto-as/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Nov 28, 2024 • 5