Update README.md
Browse files
README.md
CHANGED
|
@@ -9,7 +9,7 @@ tags:
|
|
| 9 |
|
| 10 |
# Gemma 4 12B IT DFlash (EXL3)
|
| 11 |
|
| 12 |
-
This is an **ExLlamaV3 (EXL3)** quantized version of the `gemma4-12B-it-DFlash` model.
|
| 13 |
|
| 14 |
DFlash models are specifically designed to act as **Draft Models** for Speculative Decoding, allowing you to generate text significantly faster when paired with a larger main model. These were quantized using the Ampere-optimized `mul1` codebook for maximum decoding speed on modern GPUs.
|
| 15 |
|
|
|
|
| 9 |
|
| 10 |
# Gemma 4 12B IT DFlash (EXL3)
|
| 11 |
|
| 12 |
+
This is an **ExLlamaV3 (EXL3)** quantized version of the `z-lab/gemma4-12B-it-DFlash` model.
|
| 13 |
|
| 14 |
DFlash models are specifically designed to act as **Draft Models** for Speculative Decoding, allowing you to generate text significantly faster when paired with a larger main model. These were quantized using the Ampere-optimized `mul1` codebook for maximum decoding speed on modern GPUs.
|
| 15 |
|