Configuration Parsing Warning:In UNKNOWN_FILENAME: "quantization_config.config_groups.group_0.format" must be a string
Configuration Parsing Warning:In UNKNOWN_FILENAME: "quantization_config.config_groups.group_0.weights" must be of type object
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-sym-GS-32-KVS-attn_head
License and Llama Use Statement
This model is a quantized version of meta-llama/Llama-3.1-8B-Instruct.
Built with Llama.
This repository provides quantized weights for research and deployment evaluation. The model is subject to the Llama 3.1 Community License and Meta's Acceptable Use Policy. Users must comply with the license terms of the original Llama 3.1 model, including applicable use restrictions, attribution requirements, and acceptable-use requirements.
Llama 3.1 is licensed under the Llama 3.1 Community License, Copyright 漏 Meta Platforms, Inc. All Rights Reserved.
This repository is not affiliated with, endorsed by, or sponsored by Meta.
- Downloads last month
- 28
Model tree for FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-sym-GS-32-KVS-attn_head
Base model
meta-llama/Llama-3.1-8B