GGUF
How to use from
Lemonade
Pull the model
# Download Lemonade from https://lemonade-server.ai/
lemonade pull JustData/CatPPT-7B-GGUF:Q8_0
Run and chat with the model
lemonade run user.CatPPT-7B-GGUF-Q8_0
List all available models
lemonade list
Quick Links

CatPPT 7B - GGUF

Quantized GGUF version of the model CatPPT (instruct), using Llama.Cpp Convert.py

Downloads last month
5
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for JustData/CatPPT-7B-GGUF

Quantized
(2)
this model