Instructions to use omaraboelmaaty/pastport-llm-model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use omaraboelmaaty/pastport-llm-model with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf omaraboelmaaty/pastport-llm-model # Run inference directly in the terminal: llama cli -hf omaraboelmaaty/pastport-llm-model
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf omaraboelmaaty/pastport-llm-model # Run inference directly in the terminal: llama cli -hf omaraboelmaaty/pastport-llm-model
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf omaraboelmaaty/pastport-llm-model # Run inference directly in the terminal: ./llama-cli -hf omaraboelmaaty/pastport-llm-model
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf omaraboelmaaty/pastport-llm-model # Run inference directly in the terminal: ./build/bin/llama-cli -hf omaraboelmaaty/pastport-llm-model
Use Docker
docker model run hf.co/omaraboelmaaty/pastport-llm-model
- LM Studio
- Jan
- Ollama
How to use omaraboelmaaty/pastport-llm-model with Ollama:
ollama run hf.co/omaraboelmaaty/pastport-llm-model
- Unsloth Studio
How to use omaraboelmaaty/pastport-llm-model with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for omaraboelmaaty/pastport-llm-model to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for omaraboelmaaty/pastport-llm-model to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for omaraboelmaaty/pastport-llm-model to start chatting
- Atomic Chat new
- Docker Model Runner
How to use omaraboelmaaty/pastport-llm-model with Docker Model Runner:
docker model run hf.co/omaraboelmaaty/pastport-llm-model
- Lemonade
How to use omaraboelmaaty/pastport-llm-model with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull omaraboelmaaty/pastport-llm-model
Run and chat with the model
lemonade run user.pastport-llm-model-{{QUANT_TAG}}List all available models
lemonade list
π§ PastPort LLM Model
PastPort LLM is a quantized GGUF model built on LLaMA 3 Instruct and adapted for real-time historical NPC simulation.
It powers the PastPort system --- a time-locked AI character engine designed for immersive historical interaction.
π Base Model
- Architecture: LLaMA 3 Instruct\
- Format: GGUF\
- Quantization: Q4\
- Inference Backend: llama-cpp-python\
- Context Length: 2048 tokens\
- Optimized for CUDA GPU inference
This model is derived from LLaMA 3 Instruct and further adapted for structured, character-constrained historical simulation.
π― Fine-Tuning & Adaptation
The model has been instruction-adapted and behavior-aligned for:
1οΈβ£ Historical Role Simulation
- Fixed identity (Pharaoh, Emperor, Scholar, etc.)
- Civilization-locked worldview
- Period-consistent vocabulary
2οΈβ£ Time-Locked Knowledge
- Dynamic internal year selection
- No knowledge beyond assigned historical year
- Refusal behavior for future-related questions
3οΈβ£ Structured JSON Output
The model always returns:
{
"response": "Character dialogue text",
"anim_cues": {
"emotion": ["neutral"],
"facial_expression": ["neutral"],
"gesture": ["idle"],
"head_movement": ["still"],
"tts_style": ["calm"]
}
}
This enables: - Emotion-aware TTS\
- Animation synchronization\
- Real-time streaming playback
π Training & Data Adaptation
Adaptation included:
- Instruction-following dialogue datasets\
- Synthetic historical Q&A generation\
- Role-conditioned prompts\
- Civilization-specific context templates\
- JSON-structured output enforcement
The model is optimized to:
- Stay strictly in character\
- Avoid modern references\
- Avoid post-period knowledge\
- Maintain linguistic consistency\
- Respond in Arabic or English only
No proprietary datasets were used.
π Intended Use
Designed for:
- Real-time historical NPC engines\
- Museum installations\
- VR / AR historical environments\
- Educational simulations\
- AI character storytelling
π« Out-of-Scope Use
Not intended for:
- General assistant usage\
- Modern factual QA\
- Legal or medical advice\
- Open-domain unrestricted chat
β Recommended Hardware
Minimum: - NVIDIA T4 GPU
Recommended: - NVIDIA A10G or higher
Optimized for GPU inference using llama-cpp-python.
π Example Usage
from huggingface_hub import hf_hub_download
from llama_cpp import Llama
model_path = hf_hub_download(
repo_id="omaraboelmaaty/pastport-llm-model",
filename="npc_model_q4.gguf"
)
llm = Llama(
model_path=model_path,
n_ctx=2048,
n_gpu_layers=35
)
π€ Author
Omar Abo Elmaaty
AI Developer -- Real-Time Simulation Systems
- Downloads last month
- 5
We're not able to determine the quantization variants.