Instructions to use switlydev/SysZero with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use switlydev/SysZero with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf switlydev/SysZero:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf switlydev/SysZero:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf switlydev/SysZero:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf switlydev/SysZero:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf switlydev/SysZero:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf switlydev/SysZero:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf switlydev/SysZero:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf switlydev/SysZero:Q4_K_M

Use Docker

docker model run hf.co/switlydev/SysZero:Q4_K_M

LM Studio
Jan
Ollama
How to use switlydev/SysZero with Ollama:
```
ollama run hf.co/switlydev/SysZero:Q4_K_M
```

Unsloth Studio

How to use switlydev/SysZero with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for switlydev/SysZero to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for switlydev/SysZero to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for switlydev/SysZero to start chatting

Docker Model Runner
How to use switlydev/SysZero with Docker Model Runner:
```
docker model run hf.co/switlydev/SysZero:Q4_K_M
```

Lemonade

How to use switlydev/SysZero with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull switlydev/SysZero:Q4_K_M

Run and chat with the model

lemonade run user.SysZero-Q4_K_M

List all available models

lemonade list

Atomic Chat

SysZero

Commit History

Update README.md

fb1e16d
verified

switlydev commited on 18 days ago

Trained with Unsloth - config

96d97f5
verified

Lunder commited on May 31

Trained with Unsloth

843230c
verified

Lunder commited on May 31

Add README

cf5439f
verified

Lunder commited on May 31

Trained with Unsloth - Ollama Modelfile

dd2439b
verified

Lunder commited on May 31

Trained with Unsloth - config

a8b2cb4
verified

Lunder commited on May 31

Trained with Unsloth

50d07c2
verified

Lunder commited on May 31

initial commit

8aad2b6
verified

Lunder commited on May 31

Commit History

Update README.md fb1e16d verified

Trained with Unsloth - config 96d97f5 verified

Trained with Unsloth 843230c verified

Add README cf5439f verified

Trained with Unsloth - Ollama Modelfile dd2439b verified

Trained with Unsloth - config a8b2cb4 verified

Trained with Unsloth 50d07c2 verified

initial commit 8aad2b6 verified

Update README.md

fb1e16d
verified

Trained with Unsloth - config

96d97f5
verified

Trained with Unsloth

843230c
verified

Add README

cf5439f
verified

Trained with Unsloth - Ollama Modelfile

dd2439b
verified

Trained with Unsloth - config

a8b2cb4
verified

Trained with Unsloth

50d07c2
verified

initial commit

8aad2b6
verified