Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,324

Base only

Active filters: vllm

hardcoremoore699/Qwopus3.5-27B-v3-FP8-vllm-ready

Text Generation • 27B • Updated Apr 30 • 4

confamnode/Ministral-3-8B-Instruct-2512

9B • Updated Apr 30 • 9

LLM-OS-Models/gemma-4-E2B-it-Terminal-SFT-2Epoch-DDP-4GPU

Text Generation • 5B • Updated Jun 3 • 7

LLM-OS-Models/gemma-4-E4B-it-Terminal-SFT-2Epoch-DDP-4GPU

Text Generation • 8B • Updated Jun 3 • 7

YuYu1015/Huihui-Qwen3.6-27B-abliterated-int4-AutoRound

Text Generation • 6B • Updated May 3 • 1.73k • 1

mlx-community/gpt-oss-20b-mxfp4-bf16

Text Generation • 21B • Updated Apr 30 • 198

mlx-community/gpt-oss-120b-mxfp4-bf16

Text Generation • 117B • Updated Apr 30 • 1.87k • 2

rdtand/Gemma4-31B-IT-PrismaQuant-5.5bit-vllm

Text Generation • 19B • Updated 6 days ago • 407 • 1

RedHatAI/Laguna-XS.2-FP8

Text Generation • 33B • Updated Jun 26 • 132

RedHatAI/Laguna-XS.2-NVFP4

Text Generation • 20B • Updated Jun 26 • 207 • 1

LLM-OS-Models/gemma-4-26B-A4B-it-Terminal-SFT-1Epoch-HF-FSDP-2BData

Text Generation • 3B • Updated May 9 • 13

vfrome/Behemoth-X-123B-v2.1-FP8-Dynamic

Text Generation • 123B • Updated May 1 • 3

LLMWildling/gpt-oss-160b-kiwi

Text Generation • 165B • Updated May 1 • 13

LLM-OS-Models/gemma-4-26B-A4B-it-Terminal-SFT-2Epoch-HF-FSDP-2BData

Text Generation • 3B • Updated May 9 • 5

protoLabsAI/Qwen3.6-35B-A3B-uncensored-heretic-FP8

35B • Updated Jun 20 • 9.92k • 4

feanors/nemotron-3-nano-omni-30b-a3b-awq

Image-Text-to-Text • 33B • Updated May 1 • 661 • 3

zdy1995love/Mistral-Medium-3.5-128B-NVFP4

Text Generation • 74B • Updated May 3 • 1.75k • 3

plezan/Mistral-Medium-3.5-128B-W4A16

Image-Text-to-Text • 22B • Updated May 4 • 1.1k • 4

LLM-OS-Models/gemma-4-31B-it-Terminal-SFT-1Epoch-HF-FSDP-2BData

Text Generation • 4B • Updated May 9 • 7

CnakeCharmer/CnakeAgent-sft-v0.2

Text Generation • 22B • Updated May 1 • 12

LLM-OS-Models/gemma-4-31B-it-Terminal-SFT-2Epoch-HF-FSDP-2BData

Text Generation • 4B • Updated May 9 • 5

LLM-OS-Models/LFM2-24B-A2B-Terminal-SFT-2Epoch-HF-FSDP-2BData

Text Generation • 3B • Updated May 9 • 8

rayanos2026/gpt-oss-20b

Text Generation • 22B • Updated May 1 • 7

LLMWildling/gpt-oss-180b-goomba

Text Generation • 187B • Updated May 2 • 8

Dhiaul/Gemma-4-E4B-GLM5.1-distill

Text Generation • 8B • Updated May 2 • 1

KennethTang/MiniMax-M2.7-TQ3

88B • Updated May 2 • 9

montevive/ALIA-40b-instruct-2601-NVFP4

Text Generation • 25B • Updated May 2 • 15

Jashan887/85_Laguna_Agentic_Coding

Text Generation • 33B • Updated May 2 • 14

mradermacher/Qwen3.6-35B-A3B-Uncensored-Aggressive-GGUF

35B • Updated May 2 • 1.98k

mradermacher/Qwen3.6-27B-Uncensored-Aggressive-GGUF

27B • Updated May 3 • 232 • 2