How to use from
Lemonade
Pull the model
# Download Lemonade from https://lemonade-server.ai/
lemonade pull mys/ggml_bakllava-1:F16
Run and chat with the model
lemonade run user.ggml_bakllava-1-F16
List all available models
lemonade list
Quick Links

ggml_bakllava-1

This repo contains GGUF files to inference BakLLaVA-1 with llama.cpp end-to-end without any extra dependency.

Note: The mmproj-model-f16.gguf file structure is experimental and may change. Always use the latest code in llama.cpp.

Downloads last month
713
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support