Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

193

Base only

Active filters: compressed

puwaer/DeepSeek-V4-Flash-0731-reap-150b-gguf

Text Generation • 150B • Updated 27 days ago • 14.2k • 13

aiminify/yolov5s-compressed

Object Detection • Updated Jan 23, 2025 • 1

argmaxinc/parakeetkit-pro

Automatic Speech Recognition • Updated Sep 23, 2025 • 167k • 4

jimc86/test-llama-3.1-8b-lowrank-Q

Text Generation • 7B • Updated Sep 4, 2025

argmaxinc/parakeetkit-litert-pro

Automatic Speech Recognition • Updated Jun 9 • 4.99k

Mercity/Qwen3-8B-LaCo-Pruned

Text Generation • 6B • Updated Apr 16 • 14 • 1

Mercity/Qwen3-8B-LaCo-30L

Text Generation • 7B • Updated Dec 30, 2025 • 15

llaa33219/Solar-Open-100B-pruned-5pct-test1

36B • Updated Jan 6 • 6

llaa33219/Solar-Open-100B-pruned-5pct-test2

36B • Updated Jan 6 • 7

llaa33219/Solar-Open-100B-to-4B-test-2

4B • Updated Jan 8 • 25

llaa33219/Solar-Open-100B-to-7B-test

7B • Updated Jan 11 • 9

llaa33219/Solar-Open-100B-to-8B-test

8B • Updated Jan 11 • 16

Akicou/Qwen3-30B-A3B-Instruct-REAMINI

Text Generation • 23B • Updated Feb 23 • 24

mradermacher/Qwen3-30B-A3B-Instruct-REAMINI-GGUF

23B • Updated Mar 6 • 369

mradermacher/Qwen3-30B-A3B-Instruct-REAMINI-i1-GGUF

23B • Updated Mar 6 • 3.06k

dystrio/Mistral-7B-Instruct-v0.3-sculpt-default

Text Generation • 6B • Updated Mar 16 • 86

dystrio/Mistral-7B-Instruct-v0.3-sculpt-production

Text Generation • 6B • Updated Mar 16 • 19

dystrio/Mistral-7B-Instruct-v0.3-sculpt-throughput

Text Generation • 6B • Updated Mar 16 • 27

dystrio/Mistral-7B-Instruct-v0.3-sculpt-experimental

Text Generation • 5B • Updated Mar 16 • 15

dystrio/Llama-3.1-8B-Instruct-sculpt-default

Text Generation • 7B • Updated Mar 16 • 16

dystrio/Llama-3.1-8B-Instruct-sculpt-production

Text Generation • 6B • Updated Mar 16 • 18

dystrio/Llama-3.1-8B-Instruct-sculpt-throughput

Text Generation • 6B • Updated Mar 16 • 15

dystrio/Llama-3.1-8B-Instruct-sculpt-experimental

Text Generation • 6B • Updated Mar 16 • 22

dystrio/Qwen2.5-7B-Instruct-sculpt-default

Text Generation • 7B • Updated Mar 16 • 17

dystrio/Qwen2.5-7B-Instruct-sculpt-production

Text Generation • 6B • Updated Mar 16 • 25

dystrio/Qwen2.5-7B-Instruct-sculpt-throughput

Text Generation • 5B • Updated Mar 16 • 18 • 2

dystrio/Qwen2.5-3B-Instruct-sculpt-default

Text Generation • 3B • Updated Mar 16 • 15

dystrio/Qwen2.5-3B-Instruct-sculpt-production

Text Generation • 3B • Updated Mar 16 • 34

dystrio/Qwen2.5-3B-Instruct-sculpt-throughput

Text Generation • 2B • Updated Mar 16 • 14

dystrio/Qwen2.5-3B-Instruct-sculpt-experimental

Text Generation • 2B • Updated Mar 16 • 16