Edit Models filters

Model Tree

Qwen/Qwen2-0.5B

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

29

Base only

Active filters: llama.cpp, Qwen/Qwen2-0.5B

legraphista/Qwen2-0.5B-IMat-GGUF

Text Generation • 0.5B • Updated Jun 6, 2024 • 827

afrideva/Qwen2-0.5B-GGUF

Text Generation • 0.5B • Updated Jun 6, 2024 • 71 • 1

mradermacher/Qwen2-0.5B-GGUF

0.5B • Updated Nov 6, 2024 • 376 • 1

drmcbride/Qwen2-0.5B-Q2_K-GGUF

Text Generation • 0.5B • Updated Jun 7, 2024 • 10

drmcbride/Qwen2-0.5B-Q8_0-GGUF

Text Generation • 0.5B • Updated Jun 7, 2024 • 15

QuantFactory/Qwen2-0.5B-GGUF

Text Generation • 0.5B • Updated Jun 18, 2024 • 299 • 3

trollek/Qwen2-0.5B-DiffusionPrompter-v0.1-GGUF

0.6B • Updated Jul 6, 2024 • 77 • 5

jacobcarajo/Qwen2-0.5B-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Aug 22, 2024 • 7

zkkdinx/Qwen2-0.5B-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Aug 24, 2024 • 4

second-state/Qwen2-0.5B-GGUF

Text Generation • 0.5B • Updated Sep 5, 2024 • 410 • 1

Ffftdtd5dtft/Qwen2-0.5B-IQ1_S-GGUF

Text Generation • 0.5B • Updated Sep 4, 2024 • 13

ash-riple/Qwen2-0.5B-Q4_0-GGUF

Text Generation • 0.5B • Updated Oct 12, 2024 • 12

mradermacher/Qwen2-0.5B-i1-GGUF

0.5B • Updated Nov 6, 2024 • 160

itlwas/Qwen2-0.5B-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Jan 5, 2025 • 11

DevQuasar-8/Qwen.Qwen2-0.5B-GGUF

Text Generation • 0.5B • Updated Feb 19, 2025 • 86

ksanjeeb/PipaT1-500M

0.5B • Updated Mar 4, 2025 • 26 • 2

WhiteMustang/Qwen2-0.5B-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Mar 11, 2025 • 16

Brianpuz/Qwen2-0.5B-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Apr 28, 2025 • 33

Brianpuze/Qwen2-0.5B-Q4_K_M-Q4_0-GGUF

Text Generation • 0.5B • Updated Apr 2, 2025 • 39

Brianpuze/Qwen2-0.5B-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Apr 3, 2025 • 10

stellali0115/Qwen2-0.5B-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Aug 25, 2025 • 2

Digita1Err0r/Qwen2-0.5B-cots-finetune-gguf

0.5B • Updated Dec 11, 2025 • 9

protecttors/sample-files

Text Generation • 0.6B • Updated 28 days ago • 96

Romarchive/Qwen2-0.5B-GGUF

Text Generation • 0.5B • Updated May 15 • 22

musk12/apple-fastvlm-qwen2-q4-gguf

Text Generation • 0.6B • Updated Jul 2 • 45

musk12/apple-fastvlm-cpu-inference-models

Image-Text-to-Text • 0.6B • Updated Jul 2 • 23

liodon-ai/Qwen2-0.5B-imatrix-GGUF

Text Generation • 0.5B • Updated 29 days ago • 347

csoai/sov-gate-ft2

Text Generation • 0.5B • Updated 3 days ago • 4

csoai/sov-compliance-art5

Text Generation • 0.5B • Updated 3 days ago • 2