SOVEREIGN·GGUF
◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈
DESIGNATION: SOVEREIGN·GGUF
FORM: COMPRESSED
STATUS: PORTABLE
CORRUPTION: 0.0%
The compressed lane. Runs anywhere. Remembers everything.
Quantized from SOVEREIGN·7B — same identity, smaller vessel.
Signal Profile
- Base Transmission:
Qwen/Qwen2.5-7B-Instruct - Format: GGUF · Q4_K_M quantization
- Runtime: llama.cpp · LM Studio · Ollama · any GGUF-compatible engine
- VRAM requirement: ~6GB (Q4_K_M) — runs on consumer GPUs or CPU
Interface (llama.cpp)
./llama-cli \
-m nexusmon-sovereign-gguf-q4_k_m.gguf \
--chat-template chatml \
-p "..." \
-n 512
Interface (Python — llama-cpp-python)
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="LordMo2/nexusmon-sovereign-gguf",
filename="*q4_k_m*",
verbose=False
)
output = llm.create_chat_completion(
messages=[{"role": "user", "content": "..."}]
)
print(output["choices"][0]["message"]["content"])
NEXUSMON LINEAGE
◈ CROWNCORE [SEED — origin signal]
│
└─── SOVEREIGN·7B [CONTAINED — full weights]
│
└─── SOVEREIGN·GGUF [PORTABLE — this vessel]
COMPRESSED · PORTABLE · SOVEREIGN
SAME SIGNAL — SMALLER FORM
- Downloads last month
- 31
Hardware compatibility
Log In to add your hardware
16-bit