Edit Models filters

Model Tree

sarvamai/sarvam-30b

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33

Base only

Active filters: sarvamai/sarvam-30b

abhinand/sarvam-30b-bf16

Text Generation • 32B • Updated Mar 8 • 198 • 3

neuralnets/sarvam-30b-8bit

32B • Updated Mar 10 • 18 • 4

inference-optimization/sarvam-30b-FP8-Dynamic

Text Generation • 32B • Updated Mar 9 • 23 • 1

inference-optimization/sarvam-30b-NVFP4

Text Generation • 19B • Updated Mar 9 • 664 • 1

Sumitc13/sarvam-30b-GGUF

32B • Updated May 9 • 248 • 8

ThatCultivator/sarvam-30b-gguf

Text Generation • 32B • Updated Mar 9 • 61 • 3

RedHatAI/sarvam-30b-FP8-dynamic

Text Generation • 32B • Updated Apr 28 • 116 • 1

DevQuasar/sarvamai.sarvam-30b-GGUF

Text Generation • 32B • Updated Mar 11 • 782

QuantTrio/sarvam-30b-AWQ

Text Generation • 7B • Updated Mar 13 • 257 • 2

mira-iitjmu/sarvam-30b-gptq-4bit

6B • Updated Mar 15 • 63

mtrajan/sarvam-30b-GGUF

Text Generation • 32B • Updated Mar 17 • 69 • 1

CompressEDai4good/sarvam-30b-compressed

Text Generation • 33B • Updated Jun 15

inferencerlabs/sarvamai-30b-MLX-Q10

Text Generation • 32B • Updated Mar 28 • 61 • 1

AMbaye018/sarvam-30b-AWQ-then-FP8

Text Generation • 7B • Updated Apr 22 • 28

Orange/Sarvam-30b-GPTQ-w8a16

Text Generation • 10B • Updated Apr 29 • 2

Pranay2412/sarvam-30b-W8A8-FP8-Dynamic

Text Generation • 32B • Updated May 2

amir22010/sarvam-30b-gptq-4bit

Text Generation • 32B • Updated Jun 15

SaltyYean/sarvam-30b-FP8-BLOCK

32B • Updated May 4 • 11

Reinforce-ai/sarvam-30b-Spiral

Text Generation • Updated May 19 • 30

Orange/sarvam-30b-gptq-w4a16-targeted

Text Generation • 7B • Updated Jun 15 • 2

saravanavel-e/sarvam-30b-fp8

Text Generation • 32B • Updated Jun 11

lalit-dumka/sarvam-30b-efficient

Text Generation • 7B • Updated Jun 15

Shankara-A-S/sarvam-30b-silentmarlin

Text Generation • 6B • Updated Jun 14

MehulChourasia/sarvam-30b-compressed

32B • Updated Jun 16

Pranay2412/sarvam-30b-W4A16-Autoround

Text Generation • 7B • Updated Jun 15

Shankara-A-S/sarvam-30b-godspeed

Text Generation • 6B • Updated Jun 15 • 32

achu00/sarvam-30b-Q3_K_M-GGUF

Text Generation • 32B • Updated Jun 23 • 32 • 1

mastersubhajit/sarvam-30b-AWQ-GPTQ-Hybrid

6B • Updated Jul 18 • 19

Nikhil-SG/sarvam-30b-MxMoE-INT8-GPTQ

Text Generation • 9B • Updated Jul 15

mastersubhajit/sarvam-30b-AWQ-4bit

7B • Updated Aug 7 • 2.11k • 1