Not-For-All-Audiences

Instructions to use ShyliaSafetensors/EnceladusHyperStock-24B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ShyliaSafetensors/EnceladusHyperStock-24B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ShyliaSafetensors/EnceladusHyperStock-24B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("ShyliaSafetensors/EnceladusHyperStock-24B")
model = AutoModelForMultimodalLM.from_pretrained("ShyliaSafetensors/EnceladusHyperStock-24B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ShyliaSafetensors/EnceladusHyperStock-24B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ShyliaSafetensors/EnceladusHyperStock-24B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ShyliaSafetensors/EnceladusHyperStock-24B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/ShyliaSafetensors/EnceladusHyperStock-24B

SGLang

How to use ShyliaSafetensors/EnceladusHyperStock-24B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ShyliaSafetensors/EnceladusHyperStock-24B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ShyliaSafetensors/EnceladusHyperStock-24B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ShyliaSafetensors/EnceladusHyperStock-24B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ShyliaSafetensors/EnceladusHyperStock-24B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use ShyliaSafetensors/EnceladusHyperStock-24B with Docker Model Runner:
```
docker model run hf.co/ShyliaSafetensors/EnceladusHyperStock-24B
```
Browse Quantizations to use this model in llama.cpp, Ollama, LM Studio, or any compatible app.

EnceladusHyperStock

EnceladusHyperStock-24B is Experimental version of my previous multimerge model; 'VeryWeirdDolphinMix-V1-24B-Heretic'. And this doesnt mean this merge-model is better.

The goal was to create a model that handles complex scenes, story-writing and role-play with creativitiy and consistent.

This is a merge of pre-trained language models created using mergekit.

Thinking Capability

This model can think if these tags used:

<thinking>

</thinking>

Recommended Settings

These are my recommended settings.

Setting	Value
Temperature	0.65 - 0.85
Min P	0.05 - 0.1
Repetition penalty	1.05 - 1.1
Top P	0.75 - 0.95
Adaptive-p target	0.70 - 0.9
Adaptive-p decay	0.9

Use the Mistral V7 Tekken Template.

I recommend some tinkering with these samplers. I personally use Adaptive-P instead of 'DRY repetition penalty' or 'Rep pen'.

Intended Use

Long-form uncensored roleplay and collaborative storytelling
Uncensored creative writing
Complex instruction following with visible reasoning via <thinking>
Conversational AI with personality depth

Disclaimer

This model is uncensored and intended for adult, research, fictional story, and creative use. It may produce content that some users find offensive or inappropriate. Use responsibly.

Merge Details

Merge Methods

This model was merged using the Model Stock and Dare-Ties merge methods.

Models Merged

The following models were included in the merge:

R:\Dolphin-Mistral-GLM-4.7-Flash-24B-Venice-Edition-Thinking-Uncensored
R:\Sakura-24B-Spice
R:\Cydonia-24B-Heretic-v4
R:\WeirdCompound
R:\Broken-Tutu-24B-Unslop-v2.0
R:\MergeOutput\EnceladusDare-ties(second step model)

Configuration

The following YAML configuration(s) was used to produce this model:

first step

merge_method: dare_ties
base_model: R:\WeirdCompound
models:
  - model: R:\Dolphin-Mistral-GLM-4.7-Flash-24B-Venice-Edition-Thinking-Uncensored
    parameters:
      weight: 0.50
      density: 0.55
  - model: R:\Cydonia-24B-Heretic-v4
    parameters:
      weight: 0.45
      density: 0.50
  - model: R:\WeirdCompound
    parameters:
      weight: 0.45
      density: 0.40
dtype: bfloat16

second step (I've used Heretic in this step, 86/100 refusals to: 8/100 refusals with 0.0063 KL Divergence. Trial 92.)

merge_method: model_stock
base_model: R:\MergeOutput\EnceladusDare-ties
models:
  - model: R:\Cydonia-24B-Heretic-v4
  - model: R:\MS3.2-PaintedFantasy-v2-24B
  - model: R:\Dolphin-Mistral-GLM-4.7-Flash-24B-Venice-Edition-Thinking-Uncensored
  - model: R:\WeirdCompound
dtype: bfloat16

last step

merge_method: model_stock
base_model: R:\MergeOutput\EnceladusModelStock-Heretic
models:
  - model: R:\MergeOutput\EnceladusModelStock-Heretic
  - model: R:\Sakura-24B-Spice
  - model: R:\Dolphin-Mistral-GLM-4.7-Flash-24B-Venice-Edition-Thinking-Uncensored
  - model: R:\WeirdCompound
  - model: R:\Broken-Tutu-24B-Unslop-v2.0
  - model: R:\Cydonia-24B-Heretic-v4
dtype: bfloat16