Hugging Face's logo

rungalileo
/
mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation
llama
tensorrt-llm
int4
awq
kv-cache-quantization
mistral
Model card Files
xet
 Community
mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8
File size: 135 Bytes
21651be
 
 
1
2
3
4
version https://git-lfs.github.com/spec/v1
oid sha256:605d3b8f5a3c03acf6e77e936089d7b4a9eadca900b66b9773c2d56e90b48619
size 4247205176