Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

173

Base only

Active filters: 70b

ryzen88/Llama-3-70b-Arimas-story-RP-V1.6

Text Generation • 71B • Updated Jun 5, 2024 • 30 • 1

Vezora/Narwhal-7b

Text Generation • Updated Aug 25, 2023 • 24

ValiantLabs/Llama2-70B-ShiningValiant

Text Generation • 69B • Updated Jan 21, 2025 • 247 • 75

poisson-fish/Marcoroni-70B-v1-AWQ

Text Generation • Updated Sep 28, 2023 • 12

sequelbox/Llama2-70B-SharpBalance

Text Generation • 69B • Updated Jan 4 • 23 • 6

sequelbox/Llama2-70B-StellarBright

Text Generation • 69B • Updated May 15, 2024 • 96 • 45

TheBloke/ShiningValiant-1.2-GPTQ

Text Generation • 69B • Updated Oct 14, 2023 • 26 • 2

TheBloke/ShiningValiant-1.2-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 14

TheBloke/StellarBright-GGUF

Text Generation • 69B • Updated Oct 15, 2023 • 380 • 7

TheBloke/StellarBright-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 18

TheBloke/StellarBright-GPTQ

Text Generation • 69B • Updated Oct 15, 2023 • 20

TheBloke/ShiningValiant-1.2-GGUF

Text Generation • 69B • Updated Oct 16, 2023 • 1.31k • 9

IHaBiS/StellarBright-2.55bpw-h8-exl2

Text Generation • Updated Oct 18, 2023 • 12 • 2

LoneStriker/ShiningValiant-2.4bpw-h6-exl2

Text Generation • Updated Oct 24, 2023 • 18

LoneStriker/ShiningValiant-4.0bpw-h6-exl2

Text Generation • Updated Oct 24, 2023 • 13

LoneStriker/ShiningValiant-4.65bpw-h6-exl2

Text Generation • Updated Oct 24, 2023 • 26

LoneStriker/ShiningValiant-5.0bpw-h6-exl2

Text Generation • Updated Oct 24, 2023 • 16

LoneStriker/ShiningValiant-3.0bpw-h6-exl2

Text Generation • Updated Oct 25, 2023 • 16

LoneStriker/ShiningValiant-2.6bpw-h6-exl2

Text Generation • Updated Oct 25, 2023 • 22

LoneStriker/ShiningValiant-6.0bpw-h6-exl2

Text Generation • Updated Oct 25, 2023 • 13

sequelbox/Llama2-70B-SunsetBoulevard

Text Generation • 69B • Updated Jan 5 • 120 • 17

TheBloke/ShiningValiant-1.3-AWQ

Text Generation • 69B • Updated Dec 14, 2023 • 14

TheBloke/ShiningValiant-1.3-GGUF

Text Generation • 69B • Updated Dec 14, 2023 • 1.4k • 4

titan087/ShiningValiant-exl2-4bpw

Text Generation • Updated Dec 20, 2023 • 13

ValiantLabs/CodeLlama-70B-Esper

Text Generation • 69B • Updated Jan 21, 2025 • 49 • 2

mradermacher/Esper-70b-GGUF

69B • Updated Dec 16, 2024 • 1.28k

mradermacher/ShiningValiant-GGUF

69B • Updated Dec 16, 2024 • 1.4k • 1

backyardai/Esper-70B-GGUF

Text Generation • 69B • Updated May 22, 2024 • 953

mradermacher/Narwhal-7b-GGUF

7B • Updated May 6, 2024 • 2.38k

ValiantLabs/Llama3-70B-ShiningValiant2

Text Generation • 71B • Updated Mar 12, 2025 • 8.54k • • 5