inference-optimization
/

Llama-3.1-8B-Instruct-NVFP4

8-bit precision

compressed-tensors

Model card Files Files and versions

Llama-3.1-8B-Instruct-NVFP4 / llama3_1_8b_nvfp4.py

Commit History

Upload folder using huggingface_hub

fda0f49
verified

dsikka commited on 25 days ago