Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

281

Base only

Active filters: Qwen/Qwen3-4B

Qwen/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 21, 2025 • 277k • 133

AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF

Text Generation • 4B • Updated about 2 hours ago • 62k • 12

unsloth/Qwen3-4B-unsloth-bnb-4bit

Text Generation • 4B • Updated May 13, 2025 • 187k • 21

bartowski/Qwen_Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 7.64k • 21

Qwen/Qwen3-4B-AWQ

Text Generation • 4B • Updated May 21, 2025 • 484k • 32

prithivMLmods/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 13, 2025 • 265 • 3

zenlm/zen-eco-4b-thinking

Text Generation • 4B • Updated 20 days ago • 408 • 1

mrgoldengun/Qwen3-4B-Q2_K-GGUF

Text Generation • 4B • Updated Oct 29, 2025 • 31 • 1

litert-community/Qwen3-4B

Text Generation • Updated Jun 5 • 7.82k • 7

skilledu/qwen3-4b-heretic

Text Generation • 4B • Updated Jun 1 • 448 • 4

martin-rizzo/Qwen3-4B-INT8-ConvRot-ComfyUI

Text Generation • Updated 14 days ago • 307 • 1

SwinliQ-AIs/Qwen3-4B-GGUF

Text Generation • 4B • Updated 4 days ago • 135 • 1

unsloth/Qwen3-4B-GGUF

Text Generation • 4B • Updated Jun 8, 2025 • 85.4k • 233

unsloth/Qwen3-4B-bnb-4bit

4B • Updated May 13, 2025 • 9.06k • 3

Qwen/Qwen3-4B-FP8

Text Generation • 4B • Updated Jul 26, 2025 • 124k • 39

second-state/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 1, 2025 • 470 • 6

unsloth/Qwen3-4B-128K-GGUF

Text Generation • 4B • Updated May 25, 2025 • 1.38k • 27

gaianet/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 1, 2025 • 50

lmstudio-community/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 29, 2025 • 13.3k • 15

lmstudio-community/Qwen3-4B-MLX-4bit

Text Generation • 0.6B • Updated Apr 28, 2025 • 20.6k • 1

lmstudio-community/Qwen3-4B-MLX-8bit

Text Generation • 1B • Updated Apr 28, 2025 • 19.9k

ggml-org/Qwen3-4B-GGUF

4B • Updated Apr 28, 2025 • 2.4k • 6

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 210k • 7

qwen-community/Qwen3-4B-FP8

Text Generation • 4B • Updated Apr 28, 2025 • 604

mlx-community/Qwen3-4B-4bit

Text Generation • 0.6B • Updated Apr 28, 2025 • 17.2k • 14

mlx-community/Qwen3-4B-3bit

Text Generation • 0.5B • Updated Apr 28, 2025 • 39

NikolayKozloff/Qwen3-4B-Q8_0-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 48 • 1

mlx-community/Qwen3-4B-6bit

Text Generation • 0.9B • Updated Apr 28, 2025 • 62

mlx-community/Qwen3-4B-8bit

Text Generation • 1B • Updated Apr 28, 2025 • 3.02k • 1

tensorblock/Qwen_Qwen3-4B-GGUF

Text Generation • 4B • Updated Jan 27 • 171 • 1