Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

550

Base only

Active filters: rocm

JohnTdi/Qwen3-14B-INT4-Mixed-GPTQ

Text Generation • Updated Mar 11

JohnTdi/Qwen3-14B-INT4-Pure-GPTQ

Text Generation • Updated Mar 11

anongecko/Qwen2.5-VL-72B-Instruct-heretic-FP8

Image-Text-to-Text • 73B • Updated Mar 20 • 170 • 1

JinnP/Qwen3.5-397B-A17B-LoRA-SFT-v3

Text Generation • Updated Mar 21 • 8

JinnP/Qwen3.5-397B-A17B-LoRA-SFT-v4

Text Generation • Updated Mar 23 • 10

JinnP/Qwen3.5-397B-A17B-LoRA-SFT-v4-merged

Text Generation • 397B • Updated Mar 24 • 11 • 1

ginsongsong/eagle3-kimik2.5-w4a8

2B • Updated Mar 25 • 13

ThirdMiddle/Qwen-Image-1.9

Text-to-Image • 8B • Updated Apr 7 • 441 • 6

JinnP/Qwen3.5-lora-sft-v5-1-64k

Text Generation • Updated Apr 9 • 5

rolvai/rolv-primitive

Text Generation • Updated Apr 22

iamcode6/dinov2-l-ccmt-mi300x

Image Classification • Updated May 9 • 1

sarapatel/llama31-8b-grpo-gsm8k-run1

Text Generation • 8B • Updated Jun 16 • 8 •

iamcode6/llama32-vision-ccmt-mi300x

Image-Text-to-Text • Updated Apr 27

mattbucci/gemma-4-31B-it-AutoRound-AWQ

31B • Updated May 11 • 3.09k

mattbucci/Devstral-24B-AWQ

24B • Updated Apr 29 • 23

mattbucci/Qwen3.5-27B-AWQ

Text Generation • 27B • Updated Apr 29 • 140 • 1

mattbucci/Qwen3-Coder-30B-A3B-AWQ

31B • Updated May 26 • 18

mattbucci/gemma-4-26B-AWQ

26B • Updated May 31 • 2.94k • 1

d1272/Qwen2.5-3B-MetaPrompt-Architect

Text Generation • 3B • Updated Apr 16 • 28

pahajokiconsulting/Qwen3.6-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Apr 17 • 357 • 7

FedericoHeichou/pokemon-showdown-agent-v6-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 19 • 13

mattbucci/Qwen3.6-35B-A3B-AWQ-CT

35B • Updated Apr 26 • 171 • 2

florianleibert/kimi-k26-dflash-mi300x

Updated Apr 21 • 16

haanjack/Solar-Open-100B-MXFP4

Text Generation • 57B • Updated Apr 22 • 26

haanjack/EXAONE-4.5-33B-MXFP4

Image-Text-to-Text • 21B • Updated Apr 22 • 16

fauzanazz/Qwen3.6-27B-Q3_K_M-GGUF

Image-Text-to-Text • 27B • Updated Apr 22 • 283 • 3

mad-lab-ai/Qwen3.5-9b-tq-gguf

Text Generation • 9B • Updated Apr 23 • 108

mad-lab-ai/Qwen3.6-27B-tq-gguf

Text Generation • 27B • Updated Apr 23 • 127 • 5

haanjack/K-EXAONE-236B-A23B-MXFP4

Text Generation • 130B • Updated Apr 23 • 81 • 1

mattbucci/Qwen3.6-27B-AWQ-CT

27B • Updated Apr 26 • 107 • 1