Instructions to use Situus/STARK-WEB-12B-v1.7-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Situus/STARK-WEB-12B-v1.7-gguf with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Situus/STARK-WEB-12B-v1.7-gguf") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Situus/STARK-WEB-12B-v1.7-gguf", dtype="auto") - llama-cpp-python
How to use Situus/STARK-WEB-12B-v1.7-gguf with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="Situus/STARK-WEB-12B-v1.7-gguf", filename="STARK-WEB-12B_v1.7-f16.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Situus/STARK-WEB-12B-v1.7-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M # Run inference directly in the terminal: llama cli -hf Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M # Run inference directly in the terminal: llama cli -hf Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M
Use Docker
docker model run hf.co/Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use Situus/STARK-WEB-12B-v1.7-gguf with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Situus/STARK-WEB-12B-v1.7-gguf" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Situus/STARK-WEB-12B-v1.7-gguf", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M
- SGLang
How to use Situus/STARK-WEB-12B-v1.7-gguf with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Situus/STARK-WEB-12B-v1.7-gguf" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Situus/STARK-WEB-12B-v1.7-gguf", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Situus/STARK-WEB-12B-v1.7-gguf" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Situus/STARK-WEB-12B-v1.7-gguf", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use Situus/STARK-WEB-12B-v1.7-gguf with Ollama:
ollama run hf.co/Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M
- Unsloth Studio
How to use Situus/STARK-WEB-12B-v1.7-gguf with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Situus/STARK-WEB-12B-v1.7-gguf to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Situus/STARK-WEB-12B-v1.7-gguf to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Situus/STARK-WEB-12B-v1.7-gguf to start chatting
- Atomic Chat new
- Docker Model Runner
How to use Situus/STARK-WEB-12B-v1.7-gguf with Docker Model Runner:
docker model run hf.co/Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M
- Lemonade
How to use Situus/STARK-WEB-12B-v1.7-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Situus/STARK-WEB-12B-v1.7-gguf:Q4_K_M
Run and chat with the model
lemonade run user.STARK-WEB-12B-v1.7-gguf-Q4_K_M
List all available models
lemonade list
⚡ This is the GGUF Repository for Local Execution. This repository contains the optimized and quantized GGUF variants (
f16,q8_0,q4_k_m) specifically designed for LM Studio, llama.cpp, and other local inference clients. All files here feature a built-in, fixedenable_thinkingchat template perfectly tailored for offline usage.🔗 Looking for the original Safetensors model? Click here to visit the base model repository (STARK-WEB-12B-v1.7)
🔍 Overview
STARK-WEB-12B v1.7 is an advanced, highly specialized model fine-tuned on top of the Gemma 4 12B architecture. It draws knowledge and architecture from the world's best large language models, engineered to act as a premium UI/UX designer and frontend developer.
The model generates complete, production-grade, single-file web applications combining semantic HTML5, modern styled CSS, and interactive JavaScript. Version 1.7 brings massive improvements to overall coding logic and a huge upgrade in browser game development (Canvas API, physics, and game loops).
Unlike standard coding assistants that output plain layouts, STARK-WEB-12B uses a custom 9-step Chain-of-Thought (CoT) reasoning process. This allows the model to outline logic, palettes, structure, and constraints before writing any code, yielding visually breathtaking interfaces with fluid transitions, HSL color dynamics, glassmorphism, and responsive CSS Grid/Flexbox architectures.
📊 Quick Specifications
| Feature | Technical Details |
|---|---|
| 🧠 Base Architecture | Gemma 4 12B (via google/gemma-4-12b-it) |
| 📈 Dataset Volume | ~16 Million Tokens (highly-complex refined web app cases) |
| 🎯 Target Capabilities | Single-file dashboards, canvas games, responsive tools, fluid animations |
| 🌍 Language Support | ~90% English, ~10% Polish (fully bilingual comprehension) |
🛡️ Structured Chain-of-Thought (CoT) Workflow
To resolve logical hallucinations and infinite loops, STARK-WEB-12B v1.7 is hard-constrained to reason through a strict 9-step algorithmic roadmap prior to outputting code. This ensures it thinks precisely like a senior frontend developer.
⚙️ The 9 Reasoning Stages
- Understand the Goal: Analyze request scope, interface goals, and overall user flow.
- Inputs: Map variables, event triggers, user inputs, and storage needs.
- Output: Establish DOM results, target screens, and state resets.
- Identify Key Constraints & Technologies: Lock down browser APIs, grid constraints, and physics bounds.
- Design the HTML Structure: Plan semantic tag hierarchies and container distributions.
- Design the CSS: Map custom color variables (HSL), responsive layouts, transitions, and glow shadows.
- Design the JavaScript: Lay out event handlers, physics intervals, and rendering cycles.
- Refinement & Implementation: Synthesize code cleanups, performance tweaks, and responsiveness.
- Final Review: Final validation checklist (errors, edge-case safety, formatting).
The thinking process executes seamlessly between the <|channel>thought and <channel|> tags.
⚠️ Limitations & Best Practices
🛠️ Known Limitations & Bug Fixing
While version 1.7 represents a massive leap forward and is much better at everything, it unfortunately still makes occasional logical errors or typos that can break the code rendering. Generating complex HTML, CSS, and JS simultaneously in a single shot remains a significant challenge, especially for highly advanced games.
💡 How to fix broken code:
If your application renders as a blank screen or has broken handlers, you have two great options:
- Option A (Recommended): Copy the generated code and paste it into a larger, more capable reasoning model with a prompt to "Fix the small syntax/logical errors in this code without changing the UI design." This yields the fastest and most reliable results.
- Option B (Self-Correction): Feed the code back into STARK-WEB-12B itself with the following prompt:
"Review the generated code above. Identify any rendering or logical errors, and output a corrected, fully functional, and complete single-file version."
By using a quick second pass, you can easily bridge this gap and enjoy the stunning frontend designs the model produces.
🖥️ Client Integration Note
Because the model outputs its Chain-of-Thought inside custom structural blocks (<|channel>thought), ensure that your client UI or inference script properly parses out or wraps these tags to avoid mixing raw thoughts with the final code block. If using the GGUF files in LM Studio, ensure you are using a compatible frontend or API that supports parsing these specific custom tags.
🚀 How to Use
1. Example Prompt
The model works best when you clearly define your technical and visual requirements.
Write a fully functional Snake game in a single HTML file.
Use JavaScript and the Canvas API. Implement a modern, sleek Dark Mode design.
The game must include a score counter, collision detection, and the snake should speed up slightly after every apple eaten.
2. Python Inference Snippet
💻 Click to expand Python Hugging Face Transformers code
from transformers import AutoTokenizer, AutoModelForCausalLM
# Load the model and tokenizer (replace 'username' with your HF namespace)
tokenizer = AutoTokenizer.from_pretrained("username/stark-web-12b")
model = AutoModelForCausalLM.from_pretrained("username/stark-web-12b", device_map="auto", torch_dtype="auto")
messages = [
{"role": "user", "content": "Make a responsive, beautiful snake game in 1 file"}
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_new_tokens=4096, temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=False))
📜 Citation & License
This model is open-sourced under the Apache 2.0 license.
@misc{situus2026starkweb,
author = {Situus},
title = {STARK-WEB-12B v1.7: Optimizing Open Source Large Language Models for Structured Web Application Synthesis},
year = {2026},
publisher = {Hugging Face},
journal = {Hugging Face Model Hub}
}
- Downloads last month
- 494
4-bit
8-bit
16-bit
Model tree for Situus/STARK-WEB-12B-v1.7-gguf
Base model
Situus/STARK-WEB-12B-v1.7