Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

236

Base only

Active filters: gpu

excribe/classifer_sgd_longformer_4099

Text Classification • 0.1B • Updated May 6, 2025 • 6

lilbablo/humigencev2

Text Generation • Updated Oct 1, 2025

AhmedAyman/k2-think-cuda-1505

Text Generation • Updated Oct 26, 2025 • 6

Eltamuan/Gravitas-Torch-2.8-Blackwell-Edition

Updated Nov 3, 2025

magiccodingman/Qwen3-4B-Instruct-2507-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 648

magiccodingman/Qwen3-4B-Thinking-2507-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 41 • 1

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 76 • 1

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 105 • 2

magiccodingman/Seed-OSS-36B-Instruct-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 36B • Updated Dec 3, 2025 • 88 • 1

magiccodingman/Granite-4.0-H-350M-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 0.3B • Updated Dec 2, 2025 • 69

magiccodingman/Granite-4.0-H-1B-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 1B • Updated Dec 3, 2025 • 63

magiccodingman/Apriel-1.5-15b-Thinker-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 84

magiccodingman/Qwen3-VL-8B-Thinking-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 8B • Updated Apr 25 • 167 • 1

magiccodingman/Qwen3-VL-8B-Instruct-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 8B • Updated Dec 3, 2025 • 180 • 2

magiccodingman/Qwen3-VL-32B-Thinking-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 33B • Updated Dec 3, 2025 • 79

magiccodingman/Granite-4.0-H-350M-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 0.3B • Updated Apr 25 • 83 • 1

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 389 • 8

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 168 • 2

magiccodingman/Qwen3-30B-A3B-Thinking-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 343 • 5

magiccodingman/Qwen3-30B-A3B-Instruct-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 205 • 4

magiccodingman/Seed-OSS-36B-Instruct-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 36B • Updated Apr 25 • 817 • 10

magiccodingman/Apriel-1.5-15b-Thinker-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 128 • 2

Stan31/quantumflow-prototypes

Updated Dec 19, 2025

Jong-Seong/qwen3-next-gb10-guide

Hellohal2064/vllm-dgx-spark-gb10

Text Generation • Updated Jan 6 • 9

Jens-Duttke/DepthPro-ONNX-HighPerf

Depth Estimation • Updated Jan 30 • 8 • 1

wekkel/Qwen3-32B-Instruct-DirectML-INT4

Text Generation • Updated Jan 17 • 14

raipolymath/triton-windows

Updated Jan 23 • 1

wvvss/GPUmatLLM

Text Generation • 8B • Updated 27 days ago • 122

mahwizzzz/ur_int8_ct2

Updated Feb 17 • 10