Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

76

Base only

Active filters: cerebras

mradermacher/gemma-4-19b-a4b-it-REAP-heretic-i1-GGUF

18B • Updated Apr 10 • 2.21k • 11

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 6.29k • 77

mradermacher/gemma-4-19b-a4b-it-REAP-i1-GGUF

18B • Updated Jun 2 • 2.73k • 24

EmanuelOverride/gemma-4-26B-A4B-it-heretic-APEX-GGUF

Text Generation • 25B • Updated Aug 1 • 4.27k • 5

SebastianSchramm/Cerebras-GPT-111M-instruction

Text Generation • 0.1B • Updated Nov 28, 2023 • 249 • 3

cerebras/Llama3-DocChat-1.0-8B

Text Generation • Updated Aug 16, 2024 • 92 • • 69

NikolayKozloff/Llama3-DocChat-1.0-8B-Q8_0-GGUF

Text Generation • 8B • Updated Aug 21, 2024 • 22 • 6

mattritchey/Llama3-DocChat-1.0-8B-IQ4_NL-GGUF

Text Generation • 8B • Updated Aug 22, 2024 • 20

mattritchey/Llama3-DocChat-1.0-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 22, 2024 • 13

QuantFactory/Llama3-DocChat-1.0-8B-GGUF

Text Generation • 8B • Updated Aug 24, 2024 • 1.07k • 1

bartowski/Llama3-DocChat-1.0-8B-GGUF

Text Generation • 8B • Updated Aug 30, 2024 • 1.53k

mradermacher/Llama3-DocChat-1.0-8B-GGUF

8B • Updated Jan 22, 2025 • 553 • 1

mradermacher/Llama3-DocChat-1.0-8B-i1-GGUF

8B • Updated Jan 22, 2025 • 1.01k • 1

cerebras/Llama-3-CBHybridL-8B

Text Generation • 8B • Updated Mar 26, 2025 • 88

MatteoKhan/Cerebras-OPT-Fusion

Text Generation • 7B • Updated Apr 10, 2025 • 23

cerebras/Llama-3-CBHybridM-8B

Text Generation • 8B • Updated Mar 26, 2025 • 85

mradermacher/Cerebras-OPT-Fusion-GGUF

7B • Updated Mar 5, 2025 • 531

mradermacher/Cerebras-OPT-Fusion-i1-GGUF

7B • Updated Mar 5, 2025 • 1.17k

mradermacher/Cerebras-GPT-111M-instruction-GGUF

0.1B • Updated Jul 11, 2025 • 451

mradermacher/Cerebras-GPT-111M-instruction-i1-GGUF

0.1B • Updated Jul 11, 2025 • 863 • 1

0xSero/GLM-4.6-218B-W4A16

Text Generation • 2B • Updated May 30 • 38 • 8

0xSero/GLM-4.7-REAP-40-W4A16

Text Generation • 2B • Updated May 30 • 44 • 7

0xSero/GLM-4.7-185B

Text Generation • 185B • Updated May 30 • 87 • 19

0xSero/GLM-4.7-185B-W4A16

Text Generation • 2B • Updated May 30 • 72 • 69

0xSero/GLM-4.7-202B

Text Generation • 202B • Updated May 30 • 36 • 2

0xSero/DeepSeek-V3.2-345B-W3A16

Text Generation • 2B • Updated May 30 • 63 • 10

mlx-community/GLM-4.7-REAP-50-mixed-3-4-bits

Text Generation • 185B • Updated Jan 4 • 86 • 3

bullerwins/MiniMax-M2.1-REAP-50-GGUF

Text Generation • 116B • Updated Jan 5 • 134 • 1

mradermacher/MiniMax-M2.1-REAP-50-GGUF

116B • Updated Jan 11 • 299 • 5

Jon-Nielsen/GLM-4.7-REAP-30-W4A16

Text Generation • 2B • Updated Jan 8 • 111 • 3