W8A16 (weight-only int8) quantized, validated vs bf16

6185d7c

verified

shleekr commited on 14 days ago