Edit Models filters

Model Tree

meta-llama/Llama-2-70b-hf

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

17

Base only

Active filters: meta-llama/Llama-2-70b-hf

TheBloke/Llama-2-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 510 • 83

TheBloke/Llama-2-70B-GGUF

Text Generation • 69B • Updated Sep 27, 2023 • 898 • 30

TheBloke/Llama-2-70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 369 • 14

jamesdborin/llama2-70b-base-4bit-AWQ

Text Generation • 69B • Updated Dec 11, 2023 • 1

TitanML/llama2-70b-base-4bit-AWQ

Text Generation • 69B • Updated Apr 24, 2024 • 1

jusjinuk/Llama-2-70b-hf-2bit-LNQ

Updated Jun 19, 2025 • 3

jusjinuk/Llama-2-70b-hf-2bit-GuidedQuant-LNQ

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-70b-hf-3bit-LNQ

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-70b-hf-3bit-GuidedQuant-LNQ

Updated Jun 19, 2025 • 6

jusjinuk/Llama-2-70b-hf-4bit-LNQ

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-70b-hf-4bit-GuidedQuant-LNQ

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-70b-hf-2bit-SqueezeLLM

Updated Jun 19, 2025 • 3

jusjinuk/Llama-2-70b-hf-3bit-SqueezeLLM

Updated Jun 19, 2025 • 4

jusjinuk/Llama-2-70b-hf-4bit-SqueezeLLM

Updated Jun 19, 2025 • 4

jusjinuk/Llama-2-70b-hf-2bit-GuidedQuant-QTIP

9B • Updated Jun 19, 2025 • 4

jusjinuk/Llama-2-70b-hf-3bit-GuidedQuant-QTIP

13B • Updated Jun 19, 2025 • 3

jusjinuk/Llama-2-70b-hf-4bit-GuidedQuant-QTIP

18B • Updated Jun 19, 2025 • 2