MXFP4 Quant support?

#204
by Hugman2345 - opened

MOE models like Gemma-4-26B or Qwen A3B have good results when MXFP4, But no option here to make MXFP4, Is addition of option possible?

Sign up or log in to comment