Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,091

Base only

Active filters: mlx-my-repo

TobDeBer/Everyone-Coder-4x7b-Base-Q4-mlx

24B • Updated Dec 14, 2024 • 29 • 1

cnfusion/Llama-3.1-Nemotron-70B-Instruct-HF-Q2-mlx

Text Generation • 71B • Updated Dec 16, 2024 • 23

CuckmeisterFuller/Falcon3-10B-Instruct-Q4-mlx

Text Generation • 10B • Updated Dec 17, 2024 • 10

mlx-community/SeQwential-14B-v1-4bit

Text Generation • 15B • Updated Dec 18, 2024 • 25

cnfusion/Llama-3.3-70B-Instruct-abliterated-Q2-mlx

Text Generation • 71B • Updated Dec 19, 2024 • 222 • 1

cnfusion/Llama-3.3-70B-Instruct-Q2-mlx

Text Generation • 71B • Updated Dec 19, 2024 • 75 • 1

reach-vb/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • 0.5B • Updated Dec 24, 2024 • 16

BillSYZhang/gte-Qwen2-7B-instruct-Q4-mlx

Sentence Similarity • 8B • Updated Dec 24, 2024 • 12

ubaitur5/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • 0.5B • Updated May 1, 2025 • 30

CuckmeisterFuller/Hermes-3-Llama-3.2-3B-Q4-mlx

Text Generation • 3B • Updated Dec 27, 2024 • 46 • 1

ubaitur5/Qwen2.5-Coder-7B-Instruct-Q3-mlx

Text Generation • 8B • Updated Dec 30, 2024 • 28

alexander583/Falcon3-7B-Instruct-Q4-mlx

Text Generation • 7B • Updated Dec 30, 2024 • 8

alexander583/EXAONE-3.5-7.8B-Instruct-Q4-mlx

Text Generation • 8B • Updated Dec 31, 2024 • 34

alexander583/EXAONE-3.5-32B-Instruct-Q4-mlx

Text Generation • 32B • Updated Dec 31, 2024 • 14

ggbetz/Llama-3.1-Argunaut-1-8B-SFT-Q4-mlx

Text Generation • 8B • Updated Jan 2, 2025 • 23

cmcmaster/Llama-3.2-3B-Q4-mlx

Text Generation • 3B • Updated Jan 2, 2025 • 16

mlx-community/Qwen2.5-Coder-32B-Instruct-abliterated-4bit

Text Generation • 33B • Updated Jan 6, 2025 • 537 • 1

mlx-community/Qwen2.5-Coder-32B-Instruct-abliterated-3bit

Text Generation • 33B • Updated Jan 6, 2025 • 154 • 1

mlx-community/phi-4-abliterated-4bit

Text Generation • 15B • Updated Jan 9, 2025 • 81 • 1

mlx-community/phi-4-abliterated-8bit

Text Generation • 15B • Updated Jan 9, 2025 • 40

mlx-community/phi-4-abliterated-2bit

Text Generation • 15B • Updated Jan 9, 2025 • 33

mlx-community/phi-4-abliterated-3bit

Text Generation • 15B • Updated Jan 9, 2025 • 24

mlx-community/phi-4-abliterated-6bit

Text Generation • 15B • Updated Jan 9, 2025 • 43

cnfusion/HuatuoGPT-o1-8B-Q4-mlx

Text Generation • 8B • Updated Jan 10, 2025 • 14

ggbetz/Llama-3.3-Argunaut-1-70B-SFT-Q4-mlx

Text Generation • 71B • Updated Jan 10, 2025 • 40

CuckmeisterFuller/phi-4-Q2-mlx

Text Generation • 15B • Updated Jan 13, 2025 • 14

CuckmeisterFuller/Cydonia-v1.2-Magnum-v4-22B-Q2-mlx

Text Generation • 22B • Updated Jan 13, 2025 • 119

CuckmeisterFuller/Cydonia-v1.3-Magnum-v4-22B-Q3-mlx

Text Generation • 22B • Updated Jan 13, 2025 • 80

juanpestana/phi-4-Q4-mlx

Text Generation • 15B • Updated Jan 17, 2025 • 11

mrfakename/Wayfarer-12B-Q4-mlx

Text Generation • 12B • Updated Jan 21, 2025 • 11