NikolayKozloff/NVIDIA-Nemotron-Nano-12B-v2-Q6_K-GGUF Text Generation • 12B • Updated Aug 30, 2025 • 19 • 2
NikolayKozloff/NVIDIA-Nemotron-Nano-12B-v2-Q5_K_M-GGUF Text Generation • 12B • Updated Aug 30, 2025 • 18 • 1
NikolayKozloff/NVIDIA-Nemotron-Nano-12B-v2-Q5_K_S-GGUF Text Generation • 12B • Updated Aug 30, 2025 • 9 • 1
NikolayKozloff/NVIDIA-Nemotron-Nano-12B-v2-Q4_K_M-GGUF Text Generation • 12B • Updated Aug 30, 2025 • 12 • 1
cyankiwi/NVIDIA-Nemotron-Nano-12B-v2-AWQ-4bit Text Generation • 3B • Updated Sep 13, 2025 • 4.08k • 4
cyankiwi/NVIDIA-Nemotron-Nano-12B-v2-AWQ-8bit Text Generation • 4B • Updated Sep 13, 2025 • 3.53k • 1
straino/NVIDIA-Nemotron-Nano-9B-v2-Base-Q4_K_M-GGUF Text Generation • 9B • Updated Sep 8, 2025 • 23 • 1