NICE WORK!! | NVFP4 & AWQ+Marlin
#1
by FanaticPythoner - opened
Hey. Thanks for your work, really cool!
Could you please provide non-GGUF 4-bit quants? Precisely, NVFP4 and AWQ+Marlin?
Please let me know if you plan to do it so I can act accordingly within my organization.
Thank you very much 🙏
Thank you for your support! The model is still under testing, so its stability and performance may not yet be ideal. I am currently working on improvements and trying to make it better!