Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2412.15115

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

110

Base only

Active filters: 2412.15115

Qwen/QwQ-32B

Text Generation • 33B • Updated Mar 11, 2025 • 358k • • 2.96k

Qwen/QwQ-32B-AWQ

Text Generation • 33B • Updated Mar 11, 2025 • 31.2k • 136

Qwen/QwQ-32B-GGUF

Text Generation • 33B • Updated Mar 13, 2025 • 16.8k • 211

TayyabManan/qwen2.5-7b-urdu-v3

Text Generation • Updated Jul 1 • 1

VoidStare/Qwen2.5-14B-Instruct-1M-EXL2-8.0bpw-h8

Text Generation • Updated Jan 26, 2025 • 4

unsloth/Qwen2.5-7B-Instruct-1M

Text Generation • 8B • Updated Feb 2, 2025 • 42 • • 2

unsloth/Qwen2.5-7B-Instruct-1M-unsloth-bnb-4bit

Text Generation • 8B • Updated Feb 2, 2025 • 37 • 3

unsloth/Qwen2.5-7B-Instruct-1M-bnb-4bit

Text Generation • 8B • Updated Feb 2, 2025 • 248 • 1

unsloth/Qwen2.5-14B-Instruct-1M

Text Generation • 15B • Updated Feb 2, 2025 • 18 • • 4

unsloth/Qwen2.5-14B-Instruct-1M-unsloth-bnb-4bit

Text Generation • 15B • Updated Feb 2, 2025 • 16 • 4

unsloth/Qwen2.5-14B-Instruct-1M-bnb-4bit

Text Generation • 15B • Updated Feb 2, 2025 • 92 • 2

VoidStare/Qwen2.5-7B-Instruct-1M-EXL2-8.0bpw-h8

Text Generation • Updated Jan 27, 2025 • 6

xwen-team/Xwen-7B-Chat

Text Generation • 8B • Updated Feb 4, 2025 • 25 • • 32

xwen-team/Xwen-72B-Chat

Text Generation • 73B • Updated Feb 4, 2025 • 19 • • 32

rinna/qwen2.5-bakeneko-32b

Text Generation • 33B • Updated Mar 23, 2025 • 19 • • 7

rinna/qwen2.5-bakeneko-32b-instruct

Text Generation • 33B • Updated Mar 23, 2025 • 26 • • 7

rinna/deepseek-r1-distill-qwen2.5-bakeneko-32b

Text Generation • 33B • Updated Mar 23, 2025 • 19 • • 7

baichuan-inc/Baichuan-Audio-Base

10B • Updated Feb 25, 2025 • 43 • 12

baichuan-inc/Baichuan-Audio-Instruct

10B • Updated Feb 25, 2025 • 45 • 17

unsloth/QwQ-32B

Text Generation • 33B • Updated Apr 27, 2025 • 19 • • 17

Emova-ollm/Qwen2.5-3B-Instruct_add_speech_token_4096_nostrip

Text Generation • 3B • Updated Mar 12, 2025 • 13

Emova-ollm/Qwen2.5-7B-Instruct_add_speech_token_4096_nostrip

Feature Extraction • 7B • Updated Apr 28, 2025 • 14

Can111/m1-32b

Text Generation • 33B • Updated Aug 20, 2025 • 13 • 3

braindao/QwQ-32B

Text Generation • 33B • Updated Mar 12, 2025 • 6

rinna/qwq-bakeneko-32b

Text Generation • 33B • Updated Mar 23, 2025 • 19 • • 21

rinna/qwq-bakeneko-32b-awq

Text Generation • 33B • Updated Mar 23, 2025 • 7

rinna/qwq-bakeneko-32b-gguf

Text Generation • 33B • Updated Mar 23, 2025 • 6 • 8

rinna/qwq-bakeneko-32b-gptq-int8

Text Generation • 33B • Updated Mar 23, 2025 • 8

rinna/qwq-bakeneko-32b-gptq-int4

Text Generation • 33B • Updated Mar 23, 2025 • 6

LLMJapan/qwq-bakeneko-32b_exl2_8.0bpw

Text Generation • Updated Mar 15, 2025 • 7