twhitworth
/

Jan-nano-128k-W4A16-G128

compressed-tensors

Model card Files Files and versions

Jan-nano-128k-W4A16-G128 / recipe.yaml

twhitworth's picture

Upload folder using huggingface_hub

1ba8bf3 verified 11 months ago

122 Bytes

	default_stage:
	default_modifiers:
	GPTQModifier:
	targets: [Linear]
	ignore: [lm_head]
	scheme: W4A16