W8A16 (weight-only int8) quantized, validated vs bf16

17d16aa

verified

shleekr commited on 14 days ago