Useful Quants

community

AI & ML interests

Practical quantized model repackagings for local inference, focused on fast, tested, hardware-friendly variants for real homelab workloads.

Recent Activity

Mitchins published a model 6 days ago

useful-quants/Gemma-4-26B-A4B-it-W4A16-G64-BF16Vision

Mitchins updated a model 6 days ago

useful-quants/Gemma-4-26B-A4B-it-W4A16-G64-BF16Vision

Mitchins updated a model 10 days ago

useful-quants/LFM2.5-VL-3B-NVFP4-FP8-MinVRAM

View all activity

Mitchins

published a model 6 days ago

useful-quants/Gemma-4-26B-A4B-it-W4A16-G64-BF16Vision

Image-Text-to-Text • 26B • Updated 6 days ago • 33

Mitchins

updated a model 6 days ago

useful-quants/Gemma-4-26B-A4B-it-W4A16-G64-BF16Vision

Image-Text-to-Text • 26B • Updated 6 days ago • 33

Mitchins

updated 2 models 10 days ago

useful-quants/LFM2.5-VL-3B-NVFP4-FP8-MinVRAM

Image-Text-to-Text • 2B • Updated 10 days ago • 30

useful-quants/LFM2.5-VL-3B-NVFP4-FP8-Mixed

Image-Text-to-Text • 2B • Updated 10 days ago • 508

Mitchins

published 2 models 11 days ago

useful-quants/LFM2.5-VL-3B-NVFP4-FP8-MinVRAM

Image-Text-to-Text • 2B • Updated 10 days ago • 30

useful-quants/LFM2.5-VL-3B-NVFP4-FP8-Mixed

Image-Text-to-Text • 2B • Updated 10 days ago • 508

Mitchins

updated a model 15 days ago

useful-quants/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-W4A16

Text Generation • 32B • Updated 15 days ago • 745 • 1

Mitchins

published a model 16 days ago

useful-quants/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-W4A16

Text Generation • 32B • Updated 15 days ago • 745 • 1

Mitchins

updated a model 2 months ago

useful-quants/FastContext-1.0-4B-RL-w4a16-g128

Text Generation • 4B • Updated Jun 24 • 131

Mitchins

published a model 2 months ago

useful-quants/FastContext-1.0-4B-RL-w4a16-g128

Text Generation • 4B • Updated Jun 24 • 131

Mitchins

updated a model 2 months ago

useful-quants/GLM-4.6V-Flash-W4A16-BF16Vision

Image-Text-to-Text • 10B • Updated Jun 18 • 43 • 2

Mitchins

updated a model 3 months ago

useful-quants/Ministral-3-3B-Instruct-2512-W4A16-BF16Vision

Text Generation • 4B • Updated Jun 11 • 26

Mitchins

published a model 3 months ago

useful-quants/Ministral-3-3B-Instruct-2512-W4A16-BF16Vision

Text Generation • 4B • Updated Jun 11 • 26

Mitchins

updated a model 4 months ago

useful-quants/Qwen3-VL-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 4B • Updated May 7 • 14

Mitchins

published a model 4 months ago

useful-quants/Qwen3-VL-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 4B • Updated May 7 • 14

Mitchins

updated a model 4 months ago

useful-quants/Qwen3-4B-Instruct-2507-W4A16-G128

Text Generation • 4B • Updated May 6 • 8

Mitchins

published a model 4 months ago

useful-quants/Qwen3-4B-Instruct-2507-W4A16-G128

Text Generation • 4B • Updated May 6 • 8

Mitchins

updated a model 4 months ago

useful-quants/InternVL3-5-8B-W4A16-INT4

Image-Text-to-Text • 3B • Updated Apr 30 • 120

Mitchins

published a model 4 months ago

useful-quants/InternVL3-5-8B-W4A16-INT4

Image-Text-to-Text • 3B • Updated Apr 30 • 120

Mitchins

updated a model 4 months ago

useful-quants/Mistral-NeMo-Minitron-8B-Instruct-W4A16

Text Generation • 8B • Updated Apr 30 • 7

AI & ML interests

Recent Activity

Team members 1

useful-quants's activity