Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2309.00071

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,653

Base only

Active filters: 2309.00071

Qwen/Qwen2.5-VL-32B-Instruct

Image-Text-to-Text • 33B • Updated Apr 14, 2025 • 1.07M • • 499

unsloth/Qwen3-4B-unsloth-bnb-4bit

Text Generation • 4B • Updated May 13, 2025 • 187k • 21

unsloth/Qwen3-14B-GGUF

Text Generation • 15B • Updated Jun 8, 2025 • 35.2k • 137

unsloth/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jun 8, 2025 • 60.8k • 285

Qwen/Qwen3-30B-A3B-FP8

Text Generation • 31B • Updated Jul 26, 2025 • 171k • 86

Qwen/Qwen3-32B-AWQ

Text Generation • 33B • Updated May 21, 2025 • 655k • 137

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 31B • Updated May 21, 2025 • 169k • 55

Qwen/Qwen3-4B-AWQ

Text Generation • 4B • Updated May 21, 2025 • 484k • 32

mozilla-ai/Qwen3-4B-llamafile

Text Generation • Updated May 14, 2025 • 74 • 11

Tongyi-Zhiwen/QwenLong-L1-32B

Text Generation • 33B • Updated Jun 9, 2025 • 54 • • 168

SwinliQ-AIs/Qwen3-8B

Text Generation • 8B • Updated 5 days ago • 24 • 1

SwinliQ-AIs/Qwen3-4B-GGUF

Text Generation • 4B • Updated 4 days ago • 135 • 1

NousResearch/Yarn-Llama-2-7b-64k

Text Generation • Updated Oct 7, 2023 • 166 • 26

NousResearch/Yarn-Llama-2-13b-64k

Text Generation • Updated Sep 4, 2023 • 119 • 18

NousResearch/Yarn-Llama-2-13b-128k

Text Generation • Updated Sep 4, 2023 • 184 • 113

TheBloke/Yarn-Llama-2-7B-64K-GGUF

7B • Updated Sep 27, 2023 • 520 • 9

TheBloke/Yarn-Llama-2-7B-64K-GGML

Updated Sep 27, 2023 • 5 • 3

TheBloke/Yarn-Llama-2-7B-64K-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 10 • 1

TheBloke/Yarn-Llama-2-7B-128K-GGUF

7B • Updated Sep 27, 2023 • 442 • 21

TheBloke/Yarn-Llama-2-7B-128K-GGML

Updated Sep 27, 2023 • 4 • 6

TheBloke/Yarn-Llama-2-13B-128K-GGML

Updated Sep 27, 2023 • 5 • 6

TheBloke/Yarn-Llama-2-13B-128K-GGUF

13B • Updated Sep 27, 2023 • 1.23k • 38

TheBloke/Yarn-Llama-2-13B-64K-GGML

Updated Sep 27, 2023 • 3 • 5

TheBloke/Yarn-Llama-2-13B-64K-GGUF

13B • Updated Sep 27, 2023 • 977 • 18

TheBloke/Yarn-Llama-2-13B-128K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 54 • 16

TheBloke/Yarn-Llama-2-7B-128K-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 12 • 7

TheBloke/Yarn-Llama-2-13B-64K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 20 • 1

TheBloke/Yarn-Llama-2-13B-128K-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 2

TheBloke/Yarn-Llama-2-13B-64K-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5

TheBloke/Yarn-Llama-2-7B-128K-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5 • 1