karuko24
/

Qwen3-8B-W4A16

compressed-tensors

Model card Files Files and versions

Qwen3-8B-W4A16 / recipe.yaml

karuko24's picture

Upload folder using huggingface_hub

f96a707 verified about 1 year ago

History Blame Contribute Delete

120 Bytes

	default_stage:
	default_modifiers:
	GPTQModifier:
	scheme: W4A16
	targets: Linear
	ignore: [lm_head]