quantization / lm-quant-toolkit /scripts /dump-quant-cfg-llama-sensi-milp-7b-2.sh
chen459664's picture
Add files using upload-large-folder tool
55c92b3 verified
Raw
History Blame Contribute Delete
247 Bytes
#!/bin/bash
ATTEMPT="llama-sensi-milp-7b-2"
python ../src/cli.py dump \
--type quant_config \
--model 0 \
--attempt $ATTEMPT\
--budget 4.51 \
--quant-snapshot-dir="/fdata/llm/mxq/snapshots" \
--output-file ${ATTEMPT}.csv