rungalileo
/

llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation

kv-cache-quantization

Model card Files Files and versions

llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8

Commit History

Add TRT-LLM W8A8_SQ + INT8_KV checkpoint and detailed model card

9843bf5
verified

rungalileo commited on Apr 2

initial commit

bc0b390
verified

rungalileo commited on Apr 2