Edit Models filters

Model Tree

meta-llama/Llama-2-13b-hf

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31

Base only

Active filters: meta-llama/Llama-2-13b-hf

TheBloke/Llama-2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 452 • 120

TheBloke/Llama-2-13B-GGUF

Text Generation • 13B • Updated Sep 27, 2023 • 2.48k • 70

TheBloke/Llama-2-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 417 • 14

marcsun13/Llama-2-13B-AWQ

Text Generation • 13B • Updated Nov 6, 2023 • 6

NbAiLab/nb-sau-13b-4k-step100k

Text Generation • 13B • Updated Jun 1, 2025 • 456 • 2

onuralp/Llama-2-13b-QLoRA-01

Text Generation • Updated Oct 26, 2023 • 4

onuralp/Llama-2-13b-QLoRA-02

Text Generation • Updated Oct 27, 2023 • 3

jamesdborin/llama2-13b-base-4bit-AWQ

Text Generation • 13B • Updated Dec 11, 2023 • 4

leliuga/Llama-2-13b-hf-bnb-4bit

Text Generation • 13B • Updated Apr 19, 2024 • 2

TitanML/llama2-13b-base-4bit-AWQ

Text Generation • 13B • Updated Apr 24, 2024 • 1

dganochenko/Llama-2-13B-GPTQ

Text Generation • 13B • Updated May 16, 2024 • 3

shoh99/Llama-2-13b-hf-Q8_0-GGUF

Text Generation • 13B • Updated Oct 16, 2024 • 1

AIFunOver/Llama-2-13b-hf-openvino-8bit

Text Generation • Updated Nov 7, 2024 • 3

AIFunOver/Llama-2-13b-hf-openvino-4bit

Text Generation • Updated Nov 8, 2024 • 4

tensorblock/Llama-2-13b-hf-GGUF

Text Generation • 13B • Updated Jan 27 • 34

jusjinuk/Llama-2-13b-hf-2bit-LNQ

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-13b-hf-2bit-GuidedQuant-LNQ

Updated Jun 19, 2025 • 1

jusjinuk/Llama-2-13b-hf-3bit-LNQ

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-13b-hf-3bit-GuidedQuant-LNQ

Updated Jun 19, 2025 • 5

jusjinuk/Llama-2-13b-hf-4bit-LNQ

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-13b-hf-4bit-GuidedQuant-LNQ

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-13b-hf-2bit-SqueezeLLM

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-13b-hf-3bit-SqueezeLLM

Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-13b-hf-4bit-SqueezeLLM

Updated Jun 19, 2025 • 3

jusjinuk/Llama-2-13b-hf-2bit-GuidedQuant-QTIP

2B • Updated Jun 19, 2025 • 3

jusjinuk/Llama-2-13b-hf-3bit-GuidedQuant-QTIP

3B • Updated Jun 19, 2025 • 2

jusjinuk/Llama-2-13b-hf-4bit-GuidedQuant-QTIP

4B • Updated Jun 19, 2025 • 2

stellali0115/Llama-2-13b-hf-Q4_K_M-GGUF

Text Generation • 13B • Updated Aug 25, 2025 • 5

bdbj/Llama-2-13b-qpal-hess-msq-2bit

2B • Updated Nov 13, 2025

bdbj/Llama-2-13b-qpal-hess-msq-3bit

3B • Updated Nov 13, 2025 • 1