Intel
/

gemma-4-31B-it-int4-AutoRound-V2

text-generation-inference

4-bit precision

Model card Files Files and versions

weiweiz1 commited on 2 days ago

Commit

501c5d1

·

verified ·

1 Parent(s): a6cd7a3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -7,7 +7,7 @@ tags:
 ## Model Details
-This model is an int4 model(enhanced version) with group_size 128 and symmetric quantization of [google/gemma-4-31B-it](https://huggingface.co/google/gemma-4-31B-it) generated by [intel/auto-round](https://github.com/intel/auto-round).
 Please follow the license of the original model.

 ## Model Details
+This model is an int4 model(auto-round-best recipe, enhanced version) with group_size 128 and symmetric quantization of [google/gemma-4-31B-it](https://huggingface.co/google/gemma-4-31B-it) generated by [intel/auto-round](https://github.com/intel/auto-round).
 Please follow the license of the original model.