rungalileo
/

llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation

kv-cache-quantization

Model card Files Files and versions

llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8 / rank0.safetensors

Commit History

Upload folder using huggingface_hub

5fe512a
verified

rungalileo commited on Feb 8