lmganon123
/

THUDM_GLM-Z1-32B-0414-exl3-4.0bpw

4-bit precision

Model card Files Files and versions

THUDM_GLM-Z1-32B-0414-exl3-4.0bpw / README.md

lmganon123's picture

Update README.md

dac6464 verified about 1 year ago

|

236 Bytes

base_model:
  - THUDM/GLM-Z1-32B-0414

I wish more people would make exl3 quants. I probably will be making some for 24GB VRAM.

Prompt format

[gMASK]<sop><|system|>
{system_prompt}<|user|>
{prompt}<|assistant|>
<think>