Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

38

Base only

Active filters: w8a16

Tacoin/openpi-pi0.5-libero-onnx

Robotics • Updated Jan 19 • 1

TheHouseOfTheDude/Qwen3.6-27B-INT8

Image-Text-to-Text • 28B • Updated 6 days ago • 2.88k • 7

adeepv/Qwen3.6-27B-W8A16-Ascend310P

Text Generation • Updated 3 days ago • 43 • 1

groxaxo/Huihui-gpt-oss-20b-BF16-abliterated-W8A16

20B • Updated Sep 3, 2025 • 3 • 1

groxaxo/gpt-oss-20b-ShiningValiant3-W8A16

Text Generation • 20B • Updated Sep 4, 2025 • 17 • 2

TheHouseOfTheDude/Behemoth-ReduX-123B-v1_Compressed-Tensors

Text Generation • Updated Sep 17, 2025 • 145

TheHouseOfTheDude/Qwen3-Next-80B-A3B-Instruct_Compressed-Tensors

Text Generation • Updated Sep 19, 2025

TheHouseOfTheDude/KansenSakura-Erosion-RP-12b_Compressed-Tensors

Text Generation • Updated Nov 11, 2025 • 1

avtc/GLM-4.5-Air-GPTQMODEL-W8A16

Text Generation • 116B • Updated Dec 1, 2025 • 7 • 2

TheHouseOfTheDude/Llama_3.x_70b_Hexagon_Purple_V3_Compressed-Tensors

Text Generation • Updated Dec 19, 2025

TheHouseOfTheDude/Broken-Tutu-24B_Compressed-Tensors

Text Generation • Updated Dec 23, 2025 • 1

TheHouseOfTheDude/GLM-4.7-Flash_AWQ

Text Generation • Updated Jan 29 • 1 • 3

groxaxo/Qwen3-4B-Instruct-2507-heretic-W8A16

Text Generation • 4B • Updated Feb 27 • 4 • 1

groxaxo/Qwen3.5-27B-heretic-W8A16

27B • Updated Feb 26 • 3 • 1

TheHouseOfTheDude/Qwen3.5-27B-Writer_PTQ

Text Generation • Updated Mar 18

TheHouseOfTheDude/Qwen3.5-27B-Animus-V13.0_PTQ

Text Generation • Updated Mar 18

TheHouseOfTheDude/Qwen3.5-27B_PTQ

Image-Text-to-Text • Updated Mar 19

TheHouseOfTheDude/gemma-4-31B_PTQ

Image-Text-to-Text • Updated Apr 3 • 2

groxaxo/gemma4-31b-abliterated-multimodal-awq8

Image-Text-to-Text • 34B • Updated Apr 10 • 40 • 3

TheHouseOfTheDude/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled_PTQ

Image-Text-to-Text • Updated Apr 13

TheHouseOfTheDude/Qwen3.6-35B-A3B_INT8

Image-Text-to-Text • Updated Apr 16

Orange/Sarvam-30b-GPTQ-w8a16

Text Generation • 10B • Updated Apr 29 • 668 • 2

QuaduxIT/Qwen3-Embedding-8B-W8A16

Feature Extraction • 8B • Updated May 1 • 6

QuaduxIT/Qwen3-Embedding-4B-W8A16

Feature Extraction • 4B • Updated May 1 • 7

QuaduxIT/Qwen3-VL-Embedding-8B-W8A16

Feature Extraction • 4B • Updated May 1 • 168

sona-forge/sd15-controlnet-canny-qnn-8gen3

Text-to-Image • Updated May 4

operationrange/MiniMax-M2.7-8bit

Text Generation • 60B • Updated May 5 • 325

havenoammo/Qwen3.6-27B-INT8-MTP

Image-Text-to-Text • 28B • Updated 30 days ago • 7.07k • 3

88plug/Qwen3.6-35B-A3B-W8A16

Image-Text-to-Text • 35B • Updated 13 days ago • 69

88plug/Qwen3-Omni-30B-A3B-W8A16

Text Generation • 35B • Updated 10 days ago • 108