Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2309.00071

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,652

Base only

Active filters: 2309.00071

Qwen/Qwen3-8B

Text Generation • 8B • Updated Jul 26, 2025 • 15.9M • • 1.27k

Qwen/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 12.2M • • 1.45k

Qwen/Qwen2.5-VL-7B-Instruct

Image-Text-to-Text • 8B • Updated Apr 6, 2025 • 9.33M • • 1.66k

Qwen/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 21, 2025 • 277k • 133

Qwen/Qwen3-8B-GGUF

Text Generation • 8B • Updated May 21, 2025 • 230k • 237

DeepHat/DeepHat-V1-7B

Text Generation • 8B • Updated Aug 15, 2025 • 11.6k • • 211

Qwen/Qwen3-4B

Text Generation • 4B • Updated Jul 26, 2025 • 4.52M • • 668

Qwen/QwQ-32B

Text Generation • 33B • Updated Mar 11, 2025 • 358k • • 2.96k

Qwen/Qwen3-Next-80B-A3B-Instruct

Text Generation • 81B • Updated Sep 17, 2025 • 286k • • 1.04k

Qwen/Qwen3-32B

Text Generation • 33B • Updated Jul 26, 2025 • 8.53M • • 727

Qwen/Qwen3-235B-A22B

Text Generation • 235B • Updated Jul 26, 2025 • 703k • • 1.11k

Qwen/Qwen2.5-14B-Instruct

Text Generation • 15B • Updated Sep 25, 2024 • 3.36M • • 356

Qwen/QwQ-32B-AWQ

Text Generation • 33B • Updated Mar 11, 2025 • 31.2k • 136

Qwen/Qwen3-14B

Text Generation • 15B • Updated Jul 26, 2025 • 2.84M • • 436

Qwen/Qwen3-30B-A3B

Text Generation • 31B • Updated Jul 26, 2025 • 3.08M • • 914

unsloth/Qwen3-8B-GGUF

Text Generation • 8B • Updated Jun 8, 2025 • 311k • 142

Qwen/Qwen3-14B-GGUF

Text Generation • 15B • Updated May 9, 2025 • 110k • 116

unsloth/Qwen2.5-VL-7B-Instruct-GGUF

Image-Text-to-Text • 8B • Updated May 12, 2025 • 172k • 201

unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF

Text Generation • 80B • Updated Jan 14 • 29.9k • 193

NousResearch/Yarn-Llama-2-7b-128k

Text Generation • Updated Sep 4, 2023 • 940 • 41

Qwen/Qwen2.5-72B-Instruct

Text Generation • 73B • Updated Jan 12, 2025 • 446k • • 968

Qwen/Qwen2.5-Coder-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 2.01M • • 765

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • 8B • Updated Oct 9, 2024 • 4.63M • 49

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • 8B • Updated Nov 12, 2024 • 4.93k • 18

Qwen/Qwen2.5-Coder-14B-Instruct

Text Generation • 15B • Updated Jan 12, 2025 • 3.02M • • 178

Qwen/Qwen2.5-Coder-32B-Instruct

Text Generation • 33B • Updated Jan 12, 2025 • 1.21M • • 2.09k

Qwen/Qwen2.5-Coder-14B

Text Generation • 15B • Updated Nov 18, 2024 • 101k • • 85

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • 33B • Updated Nov 18, 2024 • 1.73M • 38

Qwen/Qwen2.5-VL-3B-Instruct

Image-Text-to-Text • 4B • Updated Apr 6, 2025 • 8.17M • • 681

Qwen/QwQ-32B-GGUF

Text Generation • 33B • Updated Mar 13, 2025 • 16.8k • 211