Text Generation
GGUF
English
Māori
llama.cpp
abteex-ai-labs
aotearoa
gemma
general
local-first
lumynax
new-zealand
sovereign-ai
text
vllm
vllm-compatible
vllm-experimental
nvidia-nim
nim-compatible
nim-candidate
nvidia-nemo
nem
nvidia-nemo-pathway
nem-pathway
nem-convert-required
imatrix
conversational
Instructions to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf", filename="lumynax-infused-gemma4-26b-a4b-ud-q4_k_m.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M # Run inference directly in the terminal: llama cli -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M # Run inference directly in the terminal: llama cli -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
Use Docker
docker model run hf.co/AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
- LM Studio
- Jan
- vLLM
How to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
- Ollama
How to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with Ollama:
ollama run hf.co/AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
- Unsloth Studio
How to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf to start chatting
- Pi
How to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- Docker Model Runner
How to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with Docker Model Runner:
docker model run hf.co/AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
- Lemonade
How to use AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf:UD-Q4_K_M
Run and chat with the model
lemonade run user.lumynax-infused-gemma4-26b-a4b-gguf-UD-Q4_K_M
List all available models
lemonade list
docs: expand LumynaX public model card
Browse files- README.md +227 -153
- checksums.sha256 +17 -16
- docs/lumynax-release-map.svg +33 -0
README.md
CHANGED
|
@@ -1,153 +1,227 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
library_name: llama.cpp
|
| 4 |
-
tags:
|
| 5 |
-
- lumynax
|
| 6 |
-
- abteex-ai-labs
|
| 7 |
-
- new-zealand
|
| 8 |
-
- nz-data
|
| 9 |
-
- model-infusion
|
| 10 |
-
- inference-chaining
|
| 11 |
-
- gguf
|
| 12 |
-
- llama-cpp
|
| 13 |
-
- local-ai
|
| 14 |
-
---
|
| 15 |
-
|
| 16 |
-
# LumynaX Infused Gemma4 26B A4B GGUF
|
| 17 |
-
|
| 18 |
-
LumynaX Infused Gemma4 26B A4B GGUF is a LumynaX model-infusion release from AbteeX AI Labs. It is packaged for public-facing Hugging Face distribution with explicit upstream provenance, local runtime instructions, checksums, and LumynaX release metadata.
|
| 19 |
-
|
| 20 |
-
## LumynaX Infusion Identity
|
| 21 |
-
|
| 22 |
-
LumynaX is the AbteeX AI Labs model and inference-chain family oriented around Aotearoa New Zealand data, local context, and practical edge deployment. In this release, the upstream model artifact is preserved and fed through the LumynaX release layer: packaging, prompts, inference-chain metadata, documentation, local runners, and validation records.
|
| 23 |
-
|
| 24 |
-
This means the package should be understood as a LumynaX infusion release: you are running the listed upstream model artifact through LumynaX's NZ-data-oriented inference workflow and release identity. It does not remove the upstream license or provenance, and it does not claim a private weight merge unless the manifest explicitly says so.
|
| 25 |
-
|
| 26 |
-
## Release Summary
|
| 27 |
-
|
| 28 |
-
| Field | Value |
|
| 29 |
-
| --- | --- |
|
| 30 |
-
| HF repo | `AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf` |
|
| 31 |
-
| Visibility | `public` |
|
| 32 |
-
| Commit | `2ef1645c3040e8bf3ba841a034530a099beb2518` |
|
| 33 |
-
| Upstream/source | `See release manifest` |
|
| 34 |
-
| Upstream link | See manifest |
|
| 35 |
-
| License | `apache-2.0` |
|
| 36 |
-
| Package state | `prebuilt_gguf_release` |
|
| 37 |
-
| Validation status | `hub_artifacts_present` |
|
| 38 |
-
| Modalities | `text` |
|
| 39 |
-
| GGUF included | `Yes` |
|
| 40 |
-
| Multimodal projector included | `No` |
|
| 41 |
-
| Smoke status | Published HF package with required artifacts present on the Hub; see checksums and manifest for package validation details. |
|
| 42 |
-
|
| 43 |
-
## Download And Run
|
| 44 |
-
|
| 45 |
-
```powershell
|
| 46 |
-
# Download the complete runnable package.
|
| 47 |
-
hf download AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf --local-dir lumynax-infused-gemma4-26b-a4b-gguf
|
| 48 |
-
|
| 49 |
-
# Preferred package quickstart.
|
| 50 |
-
py -3 lumynax-infused-gemma4-26b-a4b-gguf\quickstart.py --llama-cli path\to\llama-cli.exe --prompt "Reply OK." --max-new-tokens 16
|
| 51 |
-
|
| 52 |
-
# Direct llama.cpp form:
|
| 53 |
-
llama-cli -m lumynax-infused-gemma4-26b-a4b-gguf\lumynax-infused-gemma4-26b-a4b-ud-q4_k_m.gguf -p "Reply OK." -n 16
|
| 54 |
-
```
|
| 55 |
-
|
| 56 |
-
## Runtime Notes
|
| 57 |
-
|
| 58 |
-
- Use a current `llama.cpp` build for GGUF packages. The local smoke environment used `llama.cpp` build `b8840-9e5647aff` on Windows.
|
| 59 |
-
- For multimodal GGUF packages, download both the model `.gguf` and matching `mmproj` file.
|
| 60 |
-
- Very large GGUF files require substantial RAM/VRAM. If loading fails, lower context size first, then move to a larger machine.
|
| 61 |
-
- Keep all files from the release folder together: `README.md`, `quickstart.py`, `checksums.sha256`, manifests, license notice, GGUF files, Ollama files, and HF Space files where present.
|
| 62 |
-
|
| 63 |
-
## Included Artifacts
|
| 64 |
-
|
| 65 |
-
| File | Size |
|
| 66 |
-
| --- | --- |
|
| 67 |
-
| `lumynax-infused-gemma4-26b-a4b-ud-q4_k_m.gguf` | 16.95 GB |
|
| 68 |
-
| `LICENSE.txt` | 642 B |
|
| 69 |
-
| `README.md` | 2.21 KB |
|
| 70 |
-
| `VERSION.txt` | 4 B |
|
| 71 |
-
| `checksums.sha256` | 1.42 KB |
|
| 72 |
-
| `hf_space/README.md` | 1.48 KB |
|
| 73 |
-
| `hf_space/app.py` | 14.07 KB |
|
| 74 |
-
| `hf_space/requirements.txt` | 86 B |
|
| 75 |
-
| `ollama/Modelfile` | 429 B |
|
| 76 |
-
| `ollama/create_ollama_model.ps1` | 601 B |
|
| 77 |
-
| `quickstart.py` | 15.92 KB |
|
| 78 |
-
| `release_export_manifest.json` | 3.17 KB |
|
| 79 |
-
| `requirements.txt` | 26 B |
|
| 80 |
-
|
| 81 |
-
## Integrity
|
| 82 |
-
|
| 83 |
-
Every final package includes `checksums.sha256` where available. Verify after download:
|
| 84 |
-
|
| 85 |
-
```powershell
|
| 86 |
-
Get-FileHash -Algorithm SHA256 path\to\downloaded.gguf
|
| 87 |
-
Get-Content checksums.sha256
|
| 88 |
-
```
|
| 89 |
-
|
| 90 |
-
The expected package metadata is in `release_export_manifest.json` or `family_bundle_manifest.json`.
|
| 91 |
-
|
| 92 |
-
## Provenance And License
|
| 93 |
-
|
| 94 |
-
- LumynaX release publisher: AbteeX AI Labs.
|
| 95 |
-
- Upstream/source model: `See release manifest`.
|
| 96 |
-
- Weights remain subject to the upstream model license and notices.
|
| 97 |
-
- LumynaX documentation, packaging scripts, runners, and release metadata are provided to make the package easier to inspect, download, and run.
|
| 98 |
-
|
| 99 |
-
## Intended Use
|
| 100 |
-
|
| 101 |
-
This release is intended for local experimentation, inference-chain evaluation, New Zealand-context application prototyping, and reproducible GGUF/edge deployment workflows. Users are responsible for validating outputs, respecting upstream license terms, and using hardware appropriate for the selected quantization.
|
| 102 |
-
|
| 103 |
-
<!-- lumynax-public-release-block:
|
| 104 |
-
|
| 105 |
-
## LumynaX
|
| 106 |
-
|
| 107 |
-
|
| 108 |
-
|
| 109 |
-
|
| 110 |
-
|
| 111 |
-
|
| 112 |
-
|
| 113 |
-
|
| 114 |
-
|
| 115 |
-
|
| 116 |
-
|
| 117 |
-
|
| 118 |
-
|
| 119 |
-
|
| 120 |
-
|
| 121 |
-
``
|
| 122 |
-
|
| 123 |
-
|
| 124 |
-
|
| 125 |
-
|
| 126 |
-
|
| 127 |
-
``
|
| 128 |
-
|
| 129 |
-
|
| 130 |
-
|
| 131 |
-
|
| 132 |
-
|
| 133 |
-
|
| 134 |
-
|
| 135 |
-
|
| 136 |
-
|
| 137 |
-
-
|
| 138 |
-
|
| 139 |
-
|
| 140 |
-
|
| 141 |
-
|
| 142 |
-
|
| 143 |
-
|
| 144 |
-
|
| 145 |
-
|
| 146 |
-
|
| 147 |
-
|
| 148 |
-
|
| 149 |
-
|
| 150 |
-
|
| 151 |
-
|
| 152 |
-
|
| 153 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: llama.cpp
|
| 4 |
+
tags:
|
| 5 |
+
- lumynax
|
| 6 |
+
- abteex-ai-labs
|
| 7 |
+
- new-zealand
|
| 8 |
+
- nz-data
|
| 9 |
+
- model-infusion
|
| 10 |
+
- inference-chaining
|
| 11 |
+
- gguf
|
| 12 |
+
- llama-cpp
|
| 13 |
+
- local-ai
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# LumynaX Infused Gemma4 26B A4B GGUF
|
| 17 |
+
|
| 18 |
+
LumynaX Infused Gemma4 26B A4B GGUF is a LumynaX model-infusion release from AbteeX AI Labs. It is packaged for public-facing Hugging Face distribution with explicit upstream provenance, local runtime instructions, checksums, and LumynaX release metadata.
|
| 19 |
+
|
| 20 |
+
## LumynaX Infusion Identity
|
| 21 |
+
|
| 22 |
+
LumynaX is the AbteeX AI Labs model and inference-chain family oriented around Aotearoa New Zealand data, local context, and practical edge deployment. In this release, the upstream model artifact is preserved and fed through the LumynaX release layer: packaging, prompts, inference-chain metadata, documentation, local runners, and validation records.
|
| 23 |
+
|
| 24 |
+
This means the package should be understood as a LumynaX infusion release: you are running the listed upstream model artifact through LumynaX's NZ-data-oriented inference workflow and release identity. It does not remove the upstream license or provenance, and it does not claim a private weight merge unless the manifest explicitly says so.
|
| 25 |
+
|
| 26 |
+
## Release Summary
|
| 27 |
+
|
| 28 |
+
| Field | Value |
|
| 29 |
+
| --- | --- |
|
| 30 |
+
| HF repo | `AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf` |
|
| 31 |
+
| Visibility | `public` |
|
| 32 |
+
| Commit | `2ef1645c3040e8bf3ba841a034530a099beb2518` |
|
| 33 |
+
| Upstream/source | `See release manifest` |
|
| 34 |
+
| Upstream link | See manifest |
|
| 35 |
+
| License | `apache-2.0` |
|
| 36 |
+
| Package state | `prebuilt_gguf_release` |
|
| 37 |
+
| Validation status | `hub_artifacts_present` |
|
| 38 |
+
| Modalities | `text` |
|
| 39 |
+
| GGUF included | `Yes` |
|
| 40 |
+
| Multimodal projector included | `No` |
|
| 41 |
+
| Smoke status | Published HF package with required artifacts present on the Hub; see checksums and manifest for package validation details. |
|
| 42 |
+
|
| 43 |
+
## Download And Run
|
| 44 |
+
|
| 45 |
+
```powershell
|
| 46 |
+
# Download the complete runnable package.
|
| 47 |
+
hf download AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf --local-dir lumynax-infused-gemma4-26b-a4b-gguf
|
| 48 |
+
|
| 49 |
+
# Preferred package quickstart.
|
| 50 |
+
py -3 lumynax-infused-gemma4-26b-a4b-gguf\quickstart.py --llama-cli path\to\llama-cli.exe --prompt "Reply OK." --max-new-tokens 16
|
| 51 |
+
|
| 52 |
+
# Direct llama.cpp form:
|
| 53 |
+
llama-cli -m lumynax-infused-gemma4-26b-a4b-gguf\lumynax-infused-gemma4-26b-a4b-ud-q4_k_m.gguf -p "Reply OK." -n 16
|
| 54 |
+
```
|
| 55 |
+
|
| 56 |
+
## Runtime Notes
|
| 57 |
+
|
| 58 |
+
- Use a current `llama.cpp` build for GGUF packages. The local smoke environment used `llama.cpp` build `b8840-9e5647aff` on Windows.
|
| 59 |
+
- For multimodal GGUF packages, download both the model `.gguf` and matching `mmproj` file.
|
| 60 |
+
- Very large GGUF files require substantial RAM/VRAM. If loading fails, lower context size first, then move to a larger machine.
|
| 61 |
+
- Keep all files from the release folder together: `README.md`, `quickstart.py`, `checksums.sha256`, manifests, license notice, GGUF files, Ollama files, and HF Space files where present.
|
| 62 |
+
|
| 63 |
+
## Included Artifacts
|
| 64 |
+
|
| 65 |
+
| File | Size |
|
| 66 |
+
| --- | --- |
|
| 67 |
+
| `lumynax-infused-gemma4-26b-a4b-ud-q4_k_m.gguf` | 16.95 GB |
|
| 68 |
+
| `LICENSE.txt` | 642 B |
|
| 69 |
+
| `README.md` | 2.21 KB |
|
| 70 |
+
| `VERSION.txt` | 4 B |
|
| 71 |
+
| `checksums.sha256` | 1.42 KB |
|
| 72 |
+
| `hf_space/README.md` | 1.48 KB |
|
| 73 |
+
| `hf_space/app.py` | 14.07 KB |
|
| 74 |
+
| `hf_space/requirements.txt` | 86 B |
|
| 75 |
+
| `ollama/Modelfile` | 429 B |
|
| 76 |
+
| `ollama/create_ollama_model.ps1` | 601 B |
|
| 77 |
+
| `quickstart.py` | 15.92 KB |
|
| 78 |
+
| `release_export_manifest.json` | 3.17 KB |
|
| 79 |
+
| `requirements.txt` | 26 B |
|
| 80 |
+
|
| 81 |
+
## Integrity
|
| 82 |
+
|
| 83 |
+
Every final package includes `checksums.sha256` where available. Verify after download:
|
| 84 |
+
|
| 85 |
+
```powershell
|
| 86 |
+
Get-FileHash -Algorithm SHA256 path\to\downloaded.gguf
|
| 87 |
+
Get-Content checksums.sha256
|
| 88 |
+
```
|
| 89 |
+
|
| 90 |
+
The expected package metadata is in `release_export_manifest.json` or `family_bundle_manifest.json`.
|
| 91 |
+
|
| 92 |
+
## Provenance And License
|
| 93 |
+
|
| 94 |
+
- LumynaX release publisher: AbteeX AI Labs.
|
| 95 |
+
- Upstream/source model: `See release manifest`.
|
| 96 |
+
- Weights remain subject to the upstream model license and notices.
|
| 97 |
+
- LumynaX documentation, packaging scripts, runners, and release metadata are provided to make the package easier to inspect, download, and run.
|
| 98 |
+
|
| 99 |
+
## Intended Use
|
| 100 |
+
|
| 101 |
+
This release is intended for local experimentation, inference-chain evaluation, New Zealand-context application prototyping, and reproducible GGUF/edge deployment workflows. Users are responsible for validating outputs, respecting upstream license terms, and using hardware appropriate for the selected quantization.
|
| 102 |
+
|
| 103 |
+
<!-- lumynax-public-release-block:v3 -->
|
| 104 |
+
|
| 105 |
+
## Complete LumynaX Release Card
|
| 106 |
+
|
| 107 |
+
    
|
| 108 |
+
|
| 109 |
+
This section is the expanded public-facing package card for this LumynaX release. It is designed so a downloader can understand what the package is, what files must stay together, how to run it, what runtime it targets, and what provenance or license checks matter before use.
|
| 110 |
+
|
| 111 |
+
## Release At A Glance
|
| 112 |
+
|
| 113 |
+
| Field | Value |
|
| 114 |
+
| --- | --- |
|
| 115 |
+
| HF repo | `AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf` |
|
| 116 |
+
| Public status | `public` |
|
| 117 |
+
| Release type | `MoE / frontier` |
|
| 118 |
+
| Delivery | `standalone_prebuilt_gguf_release` |
|
| 119 |
+
| Package state | `prebuilt_gguf_release` |
|
| 120 |
+
| Runtime backend | `llama_cpp` |
|
| 121 |
+
| Prompt format | `gemma_chat_template` |
|
| 122 |
+
| Modalities | `text` |
|
| 123 |
+
| Primary artifact | `lumynax-infused-gemma4-26b-a4b-ud-q4_k_m.gguf` |
|
| 124 |
+
| Total detected weight size | `15.78 GB` |
|
| 125 |
+
| Upstream/base | `google/gemma-4-26B-A4B-it` |
|
| 126 |
+
| Source GGUF | `unsloth/gemma-4-26B-A4B-it-GGUF` |
|
| 127 |
+
| Quantization | `UD-Q4_K_M` |
|
| 128 |
+
| License metadata | `apache-2.0` |
|
| 129 |
+
| Last refreshed | `2026-05-10T16:48:56.111081+00:00` |
|
| 130 |
+
|
| 131 |
+
## Visual Release Map
|
| 132 |
+
|
| 133 |
+

|
| 134 |
+
|
| 135 |
+
## What "LumynaX-Infused" Means Here
|
| 136 |
+
|
| 137 |
+
This package belongs to the LumynaX model and inference-chain family from AbteeX AI Labs. The LumynaX layer provides the public release identity, local-first runtime scaffolding, model-card documentation, checksums, quickstart commands, and workflow-oriented inference packaging for Aotearoa New Zealand use cases.
|
| 138 |
+
|
| 139 |
+
Manifest indicates no private LumynaX weight merge was applied; this is a public release/package layer around the listed upstream artifact.
|
| 140 |
+
|
| 141 |
+
The practical interpretation is: download the complete repo, keep the runtime files and manifest with the model artifact, and treat the model card plus `release_export_manifest.json` as the source of truth for provenance.
|
| 142 |
+
|
| 143 |
+
## What This Package Is Best For
|
| 144 |
+
|
| 145 |
+
Use this when you want a larger sparse or frontier-style model while keeping a local GGUF release shape.
|
| 146 |
+
|
| 147 |
+
## Download And Run
|
| 148 |
+
|
| 149 |
+
```bash
|
| 150 |
+
git lfs install
|
| 151 |
+
git clone https://huggingface.co/AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf
|
| 152 |
+
cd lumynax-infused-gemma4-26b-a4b-gguf
|
| 153 |
+
pip install -r requirements.txt
|
| 154 |
+
python quickstart.py --interactive
|
| 155 |
+
```
|
| 156 |
+
|
| 157 |
+
Direct llama.cpp-style smoke prompt:
|
| 158 |
+
|
| 159 |
+
```bash
|
| 160 |
+
python quickstart.py --prompt "Who are you? Answer as LumynaX in one sentence."
|
| 161 |
+
```
|
| 162 |
+
|
| 163 |
+
## Required Runtime Components
|
| 164 |
+
|
| 165 |
+
| Component | Status | Path |
|
| 166 |
+
| --- | --- | --- |
|
| 167 |
+
| README.md | `present` | `README.md` |
|
| 168 |
+
| Quickstart | `present` | `quickstart.py` |
|
| 169 |
+
| Requirements | `present` | `requirements.txt` |
|
| 170 |
+
| Manifest | `present` | `release_export_manifest.json` |
|
| 171 |
+
| Checksums | `present` | `checksums.sha256` |
|
| 172 |
+
| License | `present` | `LICENSE.txt` |
|
| 173 |
+
| Ollama | `present` | `ollama/Modelfile` |
|
| 174 |
+
| Space scaffold | `present` | `hf_space/app.py` |
|
| 175 |
+
|
| 176 |
+
## Model Artifacts
|
| 177 |
+
|
| 178 |
+
| File | Size |
|
| 179 |
+
| --- | ---: |
|
| 180 |
+
| `lumynax-infused-gemma4-26b-a4b-ud-q4_k_m.gguf` | 15.78 GB |
|
| 181 |
+
|
| 182 |
+
## Integrity And Validation
|
| 183 |
+
|
| 184 |
+
- `checksums.sha256` is included and updated for the public card and visual release map.
|
| 185 |
+
- `release_export_manifest.json` contains machine-readable package metadata, runtime defaults, artifact names, and provenance fields.
|
| 186 |
+
- `quickstart.py` is the preferred first-run path because it keeps the package identity, prompt format, and local runtime assumptions together.
|
| 187 |
+
- Hub package audits confirm that these repos include the expected runtime files; generation speed and maximum context still depend on your RAM/VRAM and backend.
|
| 188 |
+
|
| 189 |
+
## Hardware Guidance
|
| 190 |
+
|
| 191 |
+
Frontier-size package. Plan storage, download time, and high RAM/VRAM before attempting local inference.
|
| 192 |
+
|
| 193 |
+
## Prompting And Identity
|
| 194 |
+
|
| 195 |
+
Ask identity/provenance questions directly:
|
| 196 |
+
|
| 197 |
+
```text
|
| 198 |
+
Who are you?
|
| 199 |
+
What model package is this?
|
| 200 |
+
What is the upstream model and license?
|
| 201 |
+
What files do I need to keep together to run this locally?
|
| 202 |
+
```
|
| 203 |
+
|
| 204 |
+
The LumynaX identity should be presented at runtime, while provenance remains explicit. Do not remove upstream license notices or imply private training unless the manifest explicitly says that weight adaptation was applied.
|
| 205 |
+
|
| 206 |
+
## License And Use Notes
|
| 207 |
+
|
| 208 |
+
- Check `LICENSE.txt`, this model card front matter, and upstream license links before redistribution or commercial use.
|
| 209 |
+
- Respect the upstream model license and any usage restrictions attached to the original weights or GGUF conversion.
|
| 210 |
+
- For sensitive workflows, run locally where possible, keep audit logs, and add human review for high-impact decisions.
|
| 211 |
+
|
| 212 |
+
## Support Files For Automation
|
| 213 |
+
|
| 214 |
+
Automation should prefer these files:
|
| 215 |
+
|
| 216 |
+
- `release_export_manifest.json` for structured metadata.
|
| 217 |
+
- `checksums.sha256` for file integrity.
|
| 218 |
+
- `quickstart.py` for local smoke tests.
|
| 219 |
+
- `requirements.txt` for Python dependencies.
|
| 220 |
+
- `ollama/Modelfile` where an Ollama path is included.
|
| 221 |
+
|
| 222 |
+
## Related Demo
|
| 223 |
+
|
| 224 |
+
A lightweight public LumynaX demo is available at:
|
| 225 |
+
|
| 226 |
+
- `https://huggingface.co/spaces/AbteeXAILab/lumynax-live-demo`
|
| 227 |
+
|
checksums.sha256
CHANGED
|
@@ -1,16 +1,17 @@
|
|
| 1 |
-
fdeb5cd638f262467f8cfa3f97d14d4071076dfbee5907ca4e3af7e50a3bd08b .gitattributes
|
| 2 |
-
7e88e61bb6431de4d70a4a374997a5aaeeeb00ec89d44a625f9809a4bee20d0f LICENSE.txt
|
| 3 |
-
|
| 4 |
-
ea3bd28bb3c14339d88f612541750cbd8f0cd009fd94ed6a19c8d1c543a61dcd UPLOAD_TO_HF.md
|
| 5 |
-
2dfede0e6610c473959c963b292fcec325452acba33fd1bba21110e04933df53 VERSION.txt
|
| 6 |
-
1d99734002f8838a8ffeadd0f45ab982b47c4a1c256fca4a370f71df7885b03f artifacts/release_training_summary.json
|
| 7 |
-
0a45548352aeca4b5c735e6cfd94a0c643a6c65cf4b2fcccf3e199c10750f482 hf_space/README.md
|
| 8 |
-
bfe072541daff9b157b277fe016028d50d78d3bbaec200a81a14ddbf5b40892b hf_space/app.py
|
| 9 |
-
3e78abed8cdc940c6bf1c763d81d829ec4dfe2f8b3897e5051989ef19169eaeb hf_space/requirements.txt
|
| 10 |
-
34c746b1d50ab813e29cd46c4796e3f43c741901a582f93a67b55b9fc9687b35 lumynax-infused-gemma4-26b-a4b-ud-q4_k_m.gguf
|
| 11 |
-
7936326a4bf78654e1038389020cb859183a7fdfad9b8d2ca42af19c368a63b9 merged_model/PACKAGE_STATE.txt
|
| 12 |
-
94d0f841e0cab54907ab717d1c725761940c40b7c11df602ef0760eb7637cab3 ollama/Modelfile
|
| 13 |
-
c4551e9d2e1306037200d9dabb13551c3fac7f4fb0485e971ff4b34f03a58da9 ollama/create_ollama_model.ps1
|
| 14 |
-
402034cdf3950a7d9f6eae71888a3f4e061ecbe7159b362911283f70ac144e0a quickstart.py
|
| 15 |
-
753f804a248618af551dbaa32b88135cb425f39d34c7d76ba06c00df497edf7f release_export_manifest.json
|
| 16 |
-
2a7ca962dd79646b8470b45ec926ade0a4eb01ebdd93452e6990d8997666e378 requirements.txt
|
|
|
|
|
|
| 1 |
+
fdeb5cd638f262467f8cfa3f97d14d4071076dfbee5907ca4e3af7e50a3bd08b .gitattributes
|
| 2 |
+
7e88e61bb6431de4d70a4a374997a5aaeeeb00ec89d44a625f9809a4bee20d0f LICENSE.txt
|
| 3 |
+
09d539c0ec0da1d0dc77e1f9cf261dd415ad76b428a13dbfdbadd1136876da60 README.md
|
| 4 |
+
ea3bd28bb3c14339d88f612541750cbd8f0cd009fd94ed6a19c8d1c543a61dcd UPLOAD_TO_HF.md
|
| 5 |
+
2dfede0e6610c473959c963b292fcec325452acba33fd1bba21110e04933df53 VERSION.txt
|
| 6 |
+
1d99734002f8838a8ffeadd0f45ab982b47c4a1c256fca4a370f71df7885b03f artifacts/release_training_summary.json
|
| 7 |
+
0a45548352aeca4b5c735e6cfd94a0c643a6c65cf4b2fcccf3e199c10750f482 hf_space/README.md
|
| 8 |
+
bfe072541daff9b157b277fe016028d50d78d3bbaec200a81a14ddbf5b40892b hf_space/app.py
|
| 9 |
+
3e78abed8cdc940c6bf1c763d81d829ec4dfe2f8b3897e5051989ef19169eaeb hf_space/requirements.txt
|
| 10 |
+
34c746b1d50ab813e29cd46c4796e3f43c741901a582f93a67b55b9fc9687b35 lumynax-infused-gemma4-26b-a4b-ud-q4_k_m.gguf
|
| 11 |
+
7936326a4bf78654e1038389020cb859183a7fdfad9b8d2ca42af19c368a63b9 merged_model/PACKAGE_STATE.txt
|
| 12 |
+
94d0f841e0cab54907ab717d1c725761940c40b7c11df602ef0760eb7637cab3 ollama/Modelfile
|
| 13 |
+
c4551e9d2e1306037200d9dabb13551c3fac7f4fb0485e971ff4b34f03a58da9 ollama/create_ollama_model.ps1
|
| 14 |
+
402034cdf3950a7d9f6eae71888a3f4e061ecbe7159b362911283f70ac144e0a quickstart.py
|
| 15 |
+
753f804a248618af551dbaa32b88135cb425f39d34c7d76ba06c00df497edf7f release_export_manifest.json
|
| 16 |
+
2a7ca962dd79646b8470b45ec926ade0a4eb01ebdd93452e6990d8997666e378 requirements.txt
|
| 17 |
+
4aedb86b43d3376a00325ee6901c00e71fa88ca7e315534647877dd8f8a5ecfd docs/lumynax-release-map.svg
|
docs/lumynax-release-map.svg
ADDED
|
|