Is there a BF16 version?
#2
by knoic - opened
Is there a BF16 version?
A w4a8 would be great
Absolutely need a BF16 version.
BF16 version PLZ
Non-pruned int8 convrot is optimal
bf16 is needed, I found a similar model that combines both and that has a bf16. https://huggingface.co/xmarre/MiniMax-H3-Pruned-Ref-Delta-Fused-r1024-ComfyUI
I second pruned BF16. For many GPU's that don't fully support either INT8-ConvRot or it's requirements, BF16 can be up to 10x faster in some cases