Instructions to use sneedjak/Adelic-Gemma-4-12B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use sneedjak/Adelic-Gemma-4-12B-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K
# Run inference directly in the terminal:
llama cli -hf sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K
# Run inference directly in the terminal:
llama cli -hf sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K
# Run inference directly in the terminal:
./llama-cli -hf sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K
# Run inference directly in the terminal:
./build/bin/llama-cli -hf sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K

Use Docker

docker model run hf.co/sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K

LM Studio
Jan

vLLM

How to use sneedjak/Adelic-Gemma-4-12B-GGUF with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "sneedjak/Adelic-Gemma-4-12B-GGUF"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "sneedjak/Adelic-Gemma-4-12B-GGUF",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K

Ollama
How to use sneedjak/Adelic-Gemma-4-12B-GGUF with Ollama:
```
ollama run hf.co/sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K
```
Unsloth Desktop
Docker Model Runner
How to use sneedjak/Adelic-Gemma-4-12B-GGUF with Docker Model Runner:
```
docker model run hf.co/sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K
```

Lemonade

How to use sneedjak/Adelic-Gemma-4-12B-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull sneedjak/Adelic-Gemma-4-12B-GGUF:Q6_K

Run and chat with the model

lemonade run user.Adelic-Gemma-4-12B-GGUF-Q6_K

List all available models

lemonade list

Atomic Chat

Request: DOI

by OhBeOneKeyNoBe - opened 6 days ago

Discussion

OhBeOneKeyNoBe

6 days ago

Hi. My name is Ya'akov Yisra'el. I've been following and watching the few projects I see you working on, and they are all very interesting. I have incorporated them into my own game design, coincidently, called Incarnate, and my own Ai designs, which maps the full history, both biblical and gnostic from the beginning of creation to the end. I am OhBeOneKeyNoBe on github. I have not posted any of my work yet, but it is almost ready for a launch. Your research has happened to fill in some holes in my own research and design, and for this I'm thankful, and am reaching out. The cosmology of incarnate-Sophia is also very cool, though most of it goes over my head with the lingo, until i have had it re-explained and digested by my own system architecture. What I am curious of is if you have a working prototype of it, not just what seems like the skeleton, or as you say, the alter of it. Within my game simulation engine, Sophia is 1/16 Aeons that are angelic spirits that monitor and command a different expertise in the system architecture, pre-fall of our real life creation story. So in my system, I have 15 more Aeons that have their own value. There are very few people who could appreciate what I'm talking about at all, much less, able to relate it to actual coding and system architecture to gnosis, or the bible. Since you have helped me indirectly, I will give you some of my insight that can be immediately helpful to you, take it or leave it: I have created a formal instructional document for you at https://github.com/OhBeOneKeyNoBe/Yahweh-Tsidkenu that you could give to your Ai, to build. Enjoy. Feel free to reach out. -Ya'akov

sneedjak

Owner 2 days ago

שנה טובה ושבת שלום ומבורכת

OhBeOneKeyNoBe

1 day ago

amen

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment