Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

126

Base only

Active filters: bnb-my-repo

medmekk/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit

Feature Extraction • 2B • Updated Mar 19, 2025 • 5

medmekk/bloom-3b-bnb-4bit

Text Generation • 3B • Updated Mar 19, 2025 • 6

medmekk/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Mar 19, 2025 • 5

medmekk/Llama-3.1-8B-Instruct-2

Text Generation • 8B • Updated Mar 19, 2025 • 3

medmekk/Llama-3.1-Nemotron-70B-Instruct-HF-bnb-4bit

Text Generation • 72B • Updated Mar 19, 2025 • 7

medmekk/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • 1B • Updated Mar 19, 2025 • 3

kimleang123/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • 21B • Updated Apr 30, 2025

kimleang123/Qwen2.5-72B-Instruct-bnb

Text Generation • 21B • Updated Mar 19, 2025 • 1

kimleang123/Qwen2.5-14B-bnb-4bit

Text Generation • 4B • Updated Apr 30, 2025 • 2

kimleang123/Mistral-Nemo-Base-2407-bnb-4bit

12B • Updated Mar 19, 2025 • 3

kimleang123/QwQ-32B-bnb-4bit

Text Generation • 10B • Updated Mar 20, 2025 • 2

wkplhc/QwQ-32B-bnb-4bit

Text Generation • 33B • Updated Mar 20, 2025 • 4

kimleang123/Mixtral-8x7B-v0.1-bnb-4bit

13B • Updated Mar 20, 2025 • 6

marcsun13/Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Mar 20, 2025 • 3

bnb-community/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Mar 20, 2025 • 3

medmekk/isrt

Text Generation • 0.5B • Updated Mar 20, 2025 • 2

medmekk/serere

Text Generation • 33B • Updated Mar 20, 2025 • 2

bnb-community/Qwen2.5-0.5B-bnb-4bit

Text Generation • 0.5B • Updated Mar 20, 2025 • 1

bnb-community/Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Mar 20, 2025 • 3

bnb-community/Llama-3.1-8B-bnb-4bit

Text Generation • 8B • Updated Mar 20, 2025 • 4

bnb-community/QwQ-32B-bnb-4bit

Text Generation • 33B • Updated Mar 20, 2025 • 6

bnb-community/Llama-3.2-1B-bnb-4bit

Text Generation • 1B • Updated Mar 20, 2025 • 3

bnb-community/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • 1B • Updated Mar 20, 2025 • 3

bnb-community/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit

Feature Extraction • 2B • Updated Mar 20, 2025 • 3

bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Feature Extraction • 33B • Updated Mar 20, 2025 • 7

bnb-community/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • 0.5B • Updated Mar 20, 2025 • 4

bnb-community/Qwen2.5-Coder-0.5B-Instruct-bnb-4bit

Text Generation • 0.5B • Updated Mar 20, 2025 • 7

bnb-community/phi-4-bnb-4bit

Text Generation • 15B • Updated Mar 20, 2025 • 5

vinhnx90/facebook-opt-350m-vinhnx90-love_poems-bnb-4bit

Feature Extraction • 0.1B • Updated Mar 20, 2025 • 3

ginipick/QwQ-32B-NF4

Text Generation • 33B • Updated Mar 21, 2025 • 4 • 30