exllamav3 quantizations of sophosympatheia's Glistening-Gem-31B-v1.0
Up-to-date link to the included SillyTavern Preset - please use this rather than anything included with the quants.
6.00bpw_h8 (25.503 GiB)
4.00bpw_h6 (18.356 GiB)
3.50bpw_h6 (16.647 GiB)
3.00bpw_h6 (14.947 GiB)
2.25bpw_h6 (12.389 GiB)
Model tree for MikeRoz/Glistening-Gem-31B-v1.0-exl3
Base model
sophosympatheia/Glistening-Gem-31B-v1.0