APEX Quants (GGUF)

mudler 's Collections

rf-detr.cpp

APEX Quants (GGUF)

LocalAI

updated 12 days ago

MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )

Upvote

135

mudler/Qwen3.5-35B-A3B-Claude-Distilled-APEX-GGUF

35B • Updated Apr 27 • 3.31k • 21
mudler/gemma-4-26B-A4B-it-APEX-GGUF

25B • Updated May 4 • 39.5k • 77
mudler/Qwen3.5-35B-A3B-APEX-GGUF

Text Generation • 35B • Updated Apr 27 • 20.5k • 93
mudler/Qwen3-Coder-30B-APEX-GGUF

31B • Updated Apr 27 • 2.52k • 14
mudler/MiniMax-M2.5-APEX-GGUF

229B • Updated Apr 27 • 1.1k • 3
mudler/Holo3-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 7.02k • 8
mudler/Qwen3.5-122B-A10B-APEX-GGUF

122B • Updated Apr 27 • 9.94k • 30
mudler/Qwen3.5-35B-A3B-APEX-TQ-GGUF

35B • Updated Apr 27 • 1.25k • 15
mudler/gemma-4-26B-A4B-it-Claude-Opus-Distill-APEX-GGUF

25B • Updated Apr 27 • 12.2k • 20
mudler/gemma-4-26B-A4B-it-heretic-APEX-GGUF

25B • Updated Apr 27 • 15.1k • 50
mudler/GLM-4.7-Flash-APEX-GGUF

30B • Updated Apr 27 • 2.95k • 15
mudler/Qwen3-Coder-Next-APEX-GGUF

80B • Updated Apr 27 • 10.4k • 17
mudler/Mistral-Small-4-119B-2603-APEX-GGUF

119B • Updated Apr 27 • 6.8k • 2
mudler/LFM2-24B-A2B-APEX-GGUF

24B • Updated Apr 27 • 1.16k • 8
mudler/Nemotron-3-Nano-30B-A3B-APEX-GGUF

32B • Updated Apr 27 • 1.33k • 4
mudler/NVIDIA-Nemotron-3-Super-120B-A12B-APEX-GGUF

121B • Updated Apr 27 • 1.61k • 6
mudler/Qwen3.5-397B-A17B-APEX-GGUF

396B • Updated Apr 27 • 3.66k • 3
mudler/Huihui3.5-67B-A3B-APEX-GGUF

67B • Updated Apr 27 • 986 • 3
mudler/Qwopus-MoE-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 1.04k • 19
mudler/Step-3.5-Flash-APEX-GGUF

197B • Updated Apr 27 • 823 • 6
mudler/Gemopus-4-26B-A4B-it-Preview-APEX-GGUF

25B • Updated Apr 27 • 2.54k • 6
mudler/Carnice-MoE-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 1.44k • 13
mudler/Qwen3.6-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 46.7k • 192
mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 7.82k • 26
mudler/MiniMax-M2.7-APEX-GGUF

229B • Updated Apr 27 • 1.84k • 14
mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-GGUF

35B • Updated Apr 27 • 25.4k • 82
mudler/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-APEX-GGUF

32B • Updated Apr 29 • 8.65k • 12
mudler/Qwopus3.6-35B-A3B-v1-APEX-GGUF

35B • Updated May 10 • 2.65k • 23
mudler/Darwin-36B-Opus-APEX-GGUF

35B • Updated May 15 • 10.2k • 32
mudler/Qwen3.6-35B-A3B-APEX-MTP-GGUF

36B • Updated May 21 • 90.1k • 65
mudler/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-APEX-MTP-GGUF

36B • Updated May 21 • 12.8k • 6
mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-MTP-GGUF

36B • Updated May 21 • 20.8k • 67
mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-MTP-GGUF

36B • Updated May 21 • 10.6k • 20
mudler/Qwopus3.6-35B-A3B-v1-APEX-MTP-GGUF

36B • Updated May 21 • 3.3k • 20
mudler/LFM2.5-8B-A1B-APEX-GGUF

8B • Updated Jun 30 • 4.18k • 29
mudler/Step-3.7-Flash-APEX-GGUF

197B • Updated May 29 • 3.58k • 14
mudler/Nex-N2-mini-APEX-GGUF

35B • Updated Jun 30 • 9.25k • 11
mudler/Ornith-1.0-35B-APEX-GGUF

35B • Updated Jun 30 • 17.9k • 25
mudler/Qwen-AgentWorld-35B-A3B-APEX-GGUF

35B • Updated 7 days ago • 6.36k • 12
mudler/Qwopus3.6-35B-A3B-Coder-APEX-MTP-GGUF

0.4B • Updated Jul 2 • 30.1k • 17
mudler/Qwopus3.6-35B-A3B-Coder-APEX-GGUF

35B • Updated Jul 2 • 8.81k • 2
mudler/Agents-A1-APEX-GGUF

35B • Updated Jun 30 • 19.3k • 24
mudler/Laguna-XS-2.1-APEX-GGUF

33B • Updated 13 days ago • 43.6k • 9
mudler/KAT-Coder-V2.5-Dev-APEX-GGUF

35B • Updated 13 days ago • 103k • 34

Upvote

135

Collection guide
Browse collections