SOVEREIGN·GGUF

◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈ ◈

DESIGNATION: SOVEREIGN·GGUF
FORM: COMPRESSED
STATUS: PORTABLE
CORRUPTION: 0.0%


The compressed lane. Runs anywhere. Remembers everything.

Quantized from SOVEREIGN·7B — same identity, smaller vessel.


Signal Profile

  • Base Transmission: Qwen/Qwen2.5-7B-Instruct
  • Format: GGUF · Q4_K_M quantization
  • Runtime: llama.cpp · LM Studio · Ollama · any GGUF-compatible engine
  • VRAM requirement: ~6GB (Q4_K_M) — runs on consumer GPUs or CPU

Interface (llama.cpp)

./llama-cli \
  -m nexusmon-sovereign-gguf-q4_k_m.gguf \
  --chat-template chatml \
  -p "..." \
  -n 512

Interface (Python — llama-cpp-python)

from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="LordMo2/nexusmon-sovereign-gguf",
    filename="*q4_k_m*",
    verbose=False
)
output = llm.create_chat_completion(
    messages=[{"role": "user", "content": "..."}]
)
print(output["choices"][0]["message"]["content"])

NEXUSMON LINEAGE

◈ CROWNCORE [SEED — origin signal]
│
└─── SOVEREIGN·7B [CONTAINED — full weights]
          │
          └─── SOVEREIGN·GGUF [PORTABLE — this vessel]

COMPRESSED · PORTABLE · SOVEREIGN
SAME SIGNAL — SMALLER FORM
Downloads last month
31
GGUF
Model size
40.4M params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Nexusmon/nexusmon-sovereign-gguf

Base model

Qwen/Qwen2.5-7B
Quantized
(365)
this model

Space using Nexusmon/nexusmon-sovereign-gguf 1