twhitworth
/

Jan-nano-128k-w8a8-dyn

8-bit precision

compressed-tensors

Model card Files Files and versions

Jan-nano-128k-w8a8-dyn

File size: 172 Bytes

b8736e3

default_stage:
  default_modifiers:
    SmoothQuantModifier: {smoothing_strength: 0.8}
    GPTQModifier:
      targets: [Linear]
      ignore: [lm_head]
      scheme: W8A8