Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

kv-cache-modifier

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12

Base only

Active filters: kv-cache-modifier

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-2bit-RQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-3bit-RQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-4bit-RQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-5bit-RQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-6bit-RQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-8bit-RQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-2bit-TQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-3bit-TQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-4bit-TQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-5bit-TQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-6bit-TQ-KV

Text Generation • Updated 4 days ago

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-8bit-TQ-KV

Text Generation • Updated 4 days ago