Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,022

Base only

Active filters: autoround

LeaderboardModel1/gemma-3-270m-14L-distilled-AutoRound-W4A16-RTN

Text Generation • 0.2B • Updated 2 days ago • 19

Pranay2412/sarvam-30b-W4A16-Autoround

Text Generation • 7B • Updated about 18 hours ago