Edit Models filters

Model Tree

meta-llama/Meta-Llama-3-8B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

275

Base only

Active filters: meta-llama/Meta-Llama-3-8B-Instruct

QuantFactory/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Jan 23 • 13.3k • 331

QuantFactory/Llama-3-8B-Instruct-Finance-RAG-GGUF

Text Generation • 8B • Updated Oct 20, 2024 • 614 • 61

GWsuryaYT/chronicle-narrator-gguf

8B • Updated May 25 • 11 • 2

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Apr 23, 2024 • 103k • 103

PawanKrd/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 10, 2025 • 336 • 6

brittlewis12/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Apr 29, 2024 • 138

mlc-ai/Llama-3-8B-Instruct-q0f32-MLC

Updated Sep 7, 2025

lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated May 3, 2024 • 8.52k • 192

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GPTQ

Text Generation • 8B • Updated Apr 19, 2024 • 2.72k • 7

qwp4w3hyb/Meta-Llama-3-8B-Instruct-iMat-GGUF

Text Generation • 8B • Updated Apr 29, 2024 • 1.84k • 6

mlc-ai/Llama-3-8B-Instruct-q3f16_2-MLC

Updated Sep 7, 2025 • 5 • 2

second-state/Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 19, 2024 • 388 • 7

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • 8B • Updated Apr 22, 2024 • 31 • 25

FriendliAI/Meta-Llama-3-8B-Instruct-fp8

Text Generation • 8B • Updated Nov 3, 2024 • 8 • 2

leliuga/Meta-Llama-3-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Apr 19, 2024 • 3

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • 8B • Updated Apr 22, 2024 • 21 • 26

lightblue/suzume-llama-3-8B-japanese-gguf

8B • Updated Jun 2, 2024 • 90 • 12

lkraven/Llama-3-Aplite-Instruct-4x8B-Q6_K-GGUF

Text Generation • 25B • Updated Apr 22, 2024 • 15

shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-8bit

Text Generation • 8B • Updated Jul 4, 2024 • 911 • 166

lightblue/suzume-llama-3-8B-multilingual-gguf

8B • Updated Jun 2, 2024 • 190 • 27

shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-f16

Text Generation • 8B • Updated Jul 4, 2024 • 254 • 29

LoneStriker/Llama3-8B-Chinese-Chat-3.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 4 • 1

LoneStriker/Llama3-8B-Chinese-Chat-4.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 9

LoneStriker/Llama3-8B-Chinese-Chat-5.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 8

LoneStriker/Llama3-8B-Chinese-Chat-6.0bpw-h6-exl2

Text Generation • Updated Apr 23, 2024 • 7

LoneStriker/Llama3-8B-Chinese-Chat-8.0bpw-h8-exl2

Text Generation • Updated Apr 23, 2024 • 6

solidrust/Meta-Llama-3-8B-Instruct-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 548

nisten/llama3-8b-instruct-32k-gguf

8B • Updated Apr 27, 2024 • 153 • 9

luca10g/Suzume-llama-3-8B-multilingual-Q6K-GGUF

8B • Updated Apr 27, 2024 • 23

NikolayKozloff/suzume-llama-3-8B-multilingual-Q6_K-GGUF

8B • Updated Apr 24, 2024 • 25 • 2