Excellent model! Successfully running with comfy-kitchen-fix plugin
#1
by vvzhou - opened
This model is amazing! Really impressive quality.
I have developed a plugin comfy-kitchen-fix (https://github.com/hahajaja/comfy-kitchen-fix) that adds support for this INT4 model format in ComfyUI (the comfy-kitchen fork). It handles AWQ W4A16 and SVDQuant W4A4 quantization formats, and I have successfully tested LoRA on this model — it works great!
Would you be willing to share the quantization script you used? That would enable the community to create more quantized models like this one. Thank you for your excellent work!
https://github.com/HK416-TYPED/comfy-quants/tree/feat/int4-tensorwise ,The model uses this repository for quantization.