Instructions to use LightshadeML/Roleshade-1B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use LightshadeML/Roleshade-1B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="LightshadeML/Roleshade-1B")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("LightshadeML/Roleshade-1B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use LightshadeML/Roleshade-1B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "LightshadeML/Roleshade-1B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LightshadeML/Roleshade-1B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/LightshadeML/Roleshade-1B
- SGLang
How to use LightshadeML/Roleshade-1B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "LightshadeML/Roleshade-1B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LightshadeML/Roleshade-1B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "LightshadeML/Roleshade-1B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LightshadeML/Roleshade-1B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use LightshadeML/Roleshade-1B with Docker Model Runner:
docker model run hf.co/LightshadeML/Roleshade-1B
Roleshade 1B
Status: ๐ง Weights pending release โ expected in 2โ3 weeks.
Roleshade 1B is a 1-billion-parameter model built by Lightshade for roleplay and creative writing. It is designed to run well on hardware people actually own โ phones, laptops, and CPU-only machines โ without giving up long-context conversations.
This repository is a placeholder. Model files, quantizations, and usage examples will be published here on release.
Highlights
- Purpose-built for character work. Trained for persona consistency, scene memory, and prose that resists the repetition collapse common at this parameter count.
- Fast prefill on CPUs and phones. Roleshade 1B uses a custom architecture that addresses the prefill bottleneck that makes long-context local models painful on non-GPU hardware. Loading a long chat history doesn't mean waiting on a spinner.
- Long context, anywhere. Deep, persistent roleplay sessions on a laptop, desktop, or phone.
- Local by default. Runs entirely on your own machine. Nothing leaves the device.
Intended Use
Primary: Interactive roleplay, character simulation, collaborative fiction, and creative writing assistance.
Out of scope: Factual question answering, coding assistance, math, retrieval-grounded work, safety-critical applications, or any use where the model's output is treated as authoritative. Roleshade 1B is a creative model and will confidently produce fiction.
Benchmarks
โ ๏ธ Important: The scores below are from the base instruct model, not from Roleshade 1B itself. Roleshade 1B is heavily fine-tuned for roleplay and creative writing, and will not necessarily reproduce these results. Benchmark numbers for the released roleplay model will be published separately, alongside creative-writing-specific evaluations.
| Benchmark | Score |
|---|---|
| BBH | 78.7 |
| GSM8K | 59.1 |
| GPQA-Diamond | 39.5 |
| MBPP | 51.2 |
| MMLU | 58.5 |
| MMLU-Pro | 52.7 |
| MMLU-Redux | 82.4 |
| IFEval | 88.4 |
Usage
Code samples will be added when weights are published.
# Available on release
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "lightshade/roleshade-1b"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
Roleshade 1B will also be available directly on LSAI at launch โ one click, no setup required.
Recommended sampler settings and prompt/character-card formatting will be documented here at release.
Limitations
- At 1B parameters, world knowledge is limited. Expect confident hallucination on factual topics.
- Optimized for creative output; instruction-following outside of roleplay contexts may be less reliable than the base model's benchmarks suggest.
- Long-session coherence is strong for the size class but not unlimited.
- English-first. Other languages are untested.
Responsible Use
This model is intended for adult creative fiction and roleplay. Users are responsible for how they deploy it and for complying with applicable law and the terms of any platform they run it on. Outputs are fiction and should not be relied on as advice of any kind.
License
Apache 2.0 (subject to confirmation at release).
Citation
@misc{roleshade1b,
title = {Roleshade 1B},
author = {Lightshade},
year = {2026},
url = {https://huggingface.co/LightshadeML/Roleshade-1B}
}