APEX Quants (GGUF)

mudler 's Collections

rf-detr.cpp

APEX Quants (GGUF)

LocalAI

updated 10 days ago

MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )

Upvote

132

mudler/Qwen3.5-35B-A3B-Claude-Distilled-APEX-GGUF

35B • Updated Apr 27 • 3.07k • 21
mudler/gemma-4-26B-A4B-it-APEX-GGUF

25B • Updated May 4 • 37.1k • 76
mudler/Qwen3.5-35B-A3B-APEX-GGUF

Text Generation • 35B • Updated Apr 27 • 18.6k • 93
mudler/Qwen3-Coder-30B-APEX-GGUF

31B • Updated Apr 27 • 2.47k • 14
mudler/MiniMax-M2.5-APEX-GGUF

229B • Updated Apr 27 • 966 • 3
mudler/Holo3-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 6.66k • 8
mudler/Qwen3.5-122B-A10B-APEX-GGUF

122B • Updated Apr 27 • 9.64k • 30
mudler/Qwen3.5-35B-A3B-APEX-TQ-GGUF

35B • Updated Apr 27 • 1.21k • 15
mudler/gemma-4-26B-A4B-it-Claude-Opus-Distill-APEX-GGUF

25B • Updated Apr 27 • 11.8k • 20
mudler/gemma-4-26B-A4B-it-heretic-APEX-GGUF

25B • Updated Apr 27 • 14.9k • 50
mudler/GLM-4.7-Flash-APEX-GGUF

30B • Updated Apr 27 • 2.89k • 15
mudler/Qwen3-Coder-Next-APEX-GGUF

80B • Updated Apr 27 • 10.4k • 17
mudler/Mistral-Small-4-119B-2603-APEX-GGUF

119B • Updated Apr 27 • 6.41k • 2
mudler/LFM2-24B-A2B-APEX-GGUF

24B • Updated Apr 27 • 1.13k • 8
mudler/Nemotron-3-Nano-30B-A3B-APEX-GGUF

32B • Updated Apr 27 • 7.32k • 4
mudler/NVIDIA-Nemotron-3-Super-120B-A12B-APEX-GGUF

121B • Updated Apr 27 • 1.51k • 6
mudler/Qwen3.5-397B-A17B-APEX-GGUF

396B • Updated Apr 27 • 3.44k • 3
mudler/Huihui3.5-67B-A3B-APEX-GGUF

67B • Updated Apr 27 • 966 • 3
mudler/Qwopus-MoE-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 993 • 19
mudler/Step-3.5-Flash-APEX-GGUF

197B • Updated Apr 27 • 802 • 6
mudler/Gemopus-4-26B-A4B-it-Preview-APEX-GGUF

25B • Updated Apr 27 • 2.38k • 6
mudler/Carnice-MoE-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 1.32k • 13
mudler/Qwen3.6-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 45.3k • 192
mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 7.23k • 26
mudler/MiniMax-M2.7-APEX-GGUF

229B • Updated Apr 27 • 1.68k • 14
mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-GGUF

35B • Updated Apr 27 • 24.4k • 81
mudler/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-APEX-GGUF

32B • Updated Apr 29 • 8.52k • 12
mudler/Qwopus3.6-35B-A3B-v1-APEX-GGUF

35B • Updated May 10 • 2.69k • 22
mudler/Darwin-36B-Opus-APEX-GGUF

35B • Updated May 15 • 10.1k • 32
mudler/Qwen3.6-35B-A3B-APEX-MTP-GGUF

36B • Updated May 21 • 91.2k • 65
mudler/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-APEX-MTP-GGUF

36B • Updated May 21 • 32.9k • 6
mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-MTP-GGUF

36B • Updated May 21 • 26.2k • 67
mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-MTP-GGUF

36B • Updated May 21 • 9.97k • 20
mudler/Qwopus3.6-35B-A3B-v1-APEX-MTP-GGUF

36B • Updated May 21 • 3.52k • 19
mudler/LFM2.5-8B-A1B-APEX-GGUF

8B • Updated Jun 30 • 4.52k • 28
mudler/Step-3.7-Flash-APEX-GGUF

197B • Updated May 29 • 3.5k • 14
mudler/Nex-N2-mini-APEX-GGUF

35B • Updated Jun 30 • 16.3k • 11
mudler/Ornith-1.0-35B-APEX-GGUF

35B • Updated Jun 30 • 18.5k • 25
mudler/Qwen-AgentWorld-35B-A3B-APEX-GGUF

35B • Updated 6 days ago • 7.19k • 12
mudler/Qwopus3.6-35B-A3B-Coder-APEX-MTP-GGUF

0.4B • Updated Jul 2 • 36.3k • 17
mudler/Qwopus3.6-35B-A3B-Coder-APEX-GGUF

35B • Updated Jul 2 • 8.74k • 2
mudler/Agents-A1-APEX-GGUF

35B • Updated Jun 30 • 20.6k • 24
mudler/Laguna-XS-2.1-APEX-GGUF

33B • Updated 11 days ago • 26.7k • 9
mudler/KAT-Coder-V2.5-Dev-APEX-GGUF

35B • Updated 11 days ago • 91.1k • 30

Upvote

132

Collection guide
Browse collections