Parolps
/

mistral-7b-medical-awq

compressed-tensors

Model card Files Files and versions

mistral-7b-medical-awq / recipe.yaml

Parolps's picture

Upload W4A15_ASYM quantized model

5b86035 verified 6 months ago

History Blame Contribute Delete

135 Bytes

	default_stage:
	default_modifiers:
	QuantizationModifier:
	targets: [Linear]
	ignore: [lm_head]
	scheme: W4A16_ASYM