Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

distributed-inference

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

138

Base only

Active filters: distributed-inference

meshllm/Qwen3-VL-32B-Instruct-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 1.48k

meshllm/DeepSeek-R1-Distill-Qwen-14B-Q4_K_M-layers

Text Generation • 0.3B • Updated Jul 1 • 811

meshllm/Qwen3-VL-32B-Thinking-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 1.26k • 1

meshllm/NVIDIA-Nemotron-3-Ultra-550B-A55B-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated Jul 1 • 1.87k

meshllm/Qwen3.6-27B-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated Jul 1 • 3.08k • 1

meshllm/Qwen3.5-27B-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated Jul 1 • 1.66k

meshllm/gemma-4-31B-it-qat-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 3.63k

meshllm/gemma-4-26B-A4B-it-qat-UD-Q4_K_XL-layers

Text Generation • 0.8B • Updated Jul 1 • 957 • 2

ilya-chak/gemma-4-12B-it-qat-GGUF-UD-Q4_K_XL-layers

Text Generation • 0.2B • Updated Jun 10 • 1.19k

forkjoin-ai/mamba-2.8b-safetensors

Text Generation • Updated Jun 9

forkjoin-ai/gemma-4-31b-it-gguf

Text Generation • 31B • Updated Jun 9 • 7

forkjoin-ai/falcon-mamba-7b-safetensors

Text Generation • Updated Jun 9

forkjoin-ai/flux-1-schnell

Text-to-Image • Updated Jun 9

forkjoin-ai/qwen2.5-72b-instruct-gguf

Text Generation • 73B • Updated Jun 8 • 128

meshllm/Nemotron-3-Nano-30B-A3B-Q4_K_S-layers

Text Generation • 38.7M • Updated Jul 1 • 2.71k

meshllm/NVIDIA-Nemotron-3-Ultra-550B-A55B-UD-Q4_K_S-layers

Text Generation • 0.4B • Updated Jul 1 • 1.49k • 1

meshllm/Qwen3-30B-A3B-Instruct-2507-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated Jul 1 • 1.15k

meshllm/Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated Jul 1 • 1.13k

meshllm/GLM-5.1-UD-Q3_K_XL-layers

Text Generation • 0.4B • Updated Jul 1 • 1.41k

meshllm/North-Mini-Code-1.0-UD-Q4_K_XL-layers

Text Generation • 37.8M • Updated Jul 1 • 1.21k

meshllm/diffusiongemma-26B-A4B-it-Q4_K_M-layers

Text Generation • 0.8B • Updated Jul 1 • 1.12k • 5

meshllm/GLM-4.7-Flash-MTP-GGUF

Text Generation • 31B • Updated Jul 1 • 4.92k

meshllm/MiniMax-M3-UD-Q4_K_XL-layers

Text Generation • 0.3B • Updated Jul 1 • 2.71k • 1

meshllm/DeepSeek-V3.1-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated Jul 1 • 860 • 1

meshllm/Kimi-K2.7-Code-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 2.44k • 1

forkjoin-ai/loki-erotica-8b-gguf

Text Generation • 8B • Updated Jun 15 • 1.05k • 1

meshllm/GLM-5.1-Q3_K_M-plus-layers

Text Generation • 0.4B • Updated Jul 1 • 2.73k

meshllm/GLM-5.1-UD-Q3_K_S-layers

Text Generation • 0.4B • Updated Jul 1 • 2.97k

meshllm/GLM-5.2-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated Jul 1 • 4.22k • 5

meshllm/GLM-5.2-Q2_K-MTP-Q8-layers

Text Generation • 0.4B • Updated Jul 1 • 4.63k • 1