Edit Models filters

Model Tree

sarvamai/sarvam-30b

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

30

Base only

Active filters: sarvamai/sarvam-30b

abhinand/sarvam-30b-bf16

Text Generation • 32B • Updated Mar 8 • 14 • 3

neuralnets/sarvam-30b-8bit

32B • Updated Mar 10 • 9 • 4

inference-optimization/sarvam-30b-FP8-Dynamic

Text Generation • 32B • Updated Mar 9 • 8 • 1

inference-optimization/sarvam-30b-NVFP4

Text Generation • 19B • Updated Mar 9 • 41 • 1

Sumitc13/sarvam-30b-GGUF

32B • Updated May 9 • 348 • 8

ThatCultivator/sarvam-30b-gguf

Text Generation • 32B • Updated Mar 9 • 15 • 3

RedHatAI/sarvam-30b-FP8-dynamic

Text Generation • 32B • Updated Apr 28 • 133 • 1

DevQuasar/sarvamai.sarvam-30b-GGUF

Text Generation • 32B • Updated Mar 11 • 71

QuantTrio/sarvam-30b-AWQ

Text Generation • 7B • Updated Mar 13 • 728 • 2

mira-iitjmu/sarvam-30b-gptq-4bit

6B • Updated Mar 15 • 4

mtrajan/sarvam-30b-GGUF

Text Generation • 32B • Updated Mar 17 • 22 • 1

CompressEDai4good/sarvam-30b-compressed

Text Generation • 33B • Updated Jun 15

inferencerlabs/sarvamai-30b-MLX-Q10

Text Generation • 32B • Updated Mar 28 • 40 • 1

AMbaye018/sarvam-30b-AWQ-then-FP8

Text Generation • 7B • Updated Apr 22 • 9

Orange/Sarvam-30b-GPTQ-w8a16

Text Generation • 10B • Updated Apr 29 • 2 • 2

Pranay2412/sarvam-30b-W8A8-FP8-Dynamic

Text Generation • 32B • Updated May 2

amir22010/sarvam-30b-gptq-4bit

Text Generation • 32B • Updated Jun 15

SaltyYean/sarvam-30b-FP8-BLOCK

32B • Updated May 4 • 6

Reinforce-ai/sarvam-30b-Spiral

Text Generation • Updated May 19 • 12

Orange/sarvam-30b-gptq-w4a16-targeted

Text Generation • 7B • Updated Jun 15 • 2 • 2

saravanavel-e/sarvam-30b-fp8

Text Generation • 32B • Updated Jun 11

lalit-dumka/sarvam-30b-efficient

Text Generation • 7B • Updated Jun 15

Shankara-A-S/sarvam-30b-silentmarlin

Text Generation • 6B • Updated Jun 14

MehulChourasia/sarvam-30b-compressed

32B • Updated Jun 16

Pranay2412/sarvam-30b-W4A16-Autoround

Text Generation • 7B • Updated Jun 15

Shankara-A-S/sarvam-30b-godspeed

Text Generation • 6B • Updated Jun 15 • 38

achu00/sarvam-30b-Q3_K_M-GGUF

Text Generation • 32B • Updated Jun 23 • 54 • 1

mastersubhajit/sarvam-30b-AWQ-GPTQ-Hybrid

6B • Updated 23 days ago • 1

Nikhil-SG/sarvam-30b-MxMoE-INT8-GPTQ

Text Generation • 9B • Updated 26 days ago • 58

mastersubhajit/sarvam-30b-AWQ-4bit

7B • Updated 3 days ago • 1.69k