DreamFoundries/Laguna-S-2.1-4bit
Text Generation • 118B • Updated • 239
Laguna S 2.1 MLX Quantizations
MLX-LM Laguna S 2.1 quantizations. No comparative benchmarks are available yet.
Note Uniform 4-bit affine quantization. No comparative benchmarks available yet.
DreamFoundries/Laguna-S-2.1-6bit
Text Generation • 118B • Updated • 247Note Uniform 6-bit affine quantization. No comparative benchmarks available yet.
DreamFoundries/Laguna-S-2.1-8bit
Text Generation • 118B • Updated • 260Note Uniform 8-bit affine quantization. No comparative benchmarks available yet.
DreamFoundries/Laguna-S-2.1-8bit-Att-4bit-Ex
Text Generation • 118B • Updated • 221Note 8-bit attention/base weights with 4-bit routed experts. No comparative benchmarks available yet.
DreamFoundries/Laguna-S-2.1-8bit-Att-6bit-Ex
Text Generation • 118B • Updated • 331Note 8-bit attention/base weights with 6-bit routed experts. No comparative benchmarks available yet.