Clarify release scope and connect the model portfolio
Browse filesAdd model-guide navigation and evidence-scoped artifact information. Correct applicable links, size units, runtime status, or unsupported comparisons. Preserve weights and original evaluation receipts. Wisp refreshes only the README entry in its active export manifest.
README.md
CHANGED
|
@@ -8,11 +8,22 @@ tags:
|
|
| 8 |
- int4
|
| 9 |
- apple-silicon
|
| 10 |
- ssd-streaming
|
| 11 |
-
library_name: safetensors
|
| 12 |
---
|
| 13 |
|
| 14 |
# GLM-5.2 — int4 container for iliria (full 744B, SSD-streamed)
|
| 15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
The **full** GLM-5.2 (744B total / 39B active) quantized to int4 with an int8 MTP head, packaged
|
| 17 |
as the container that [**iliria**](https://github.com/PhilipJohnBasile/iliria) serves directly.
|
| 18 |
|
|
@@ -30,7 +41,7 @@ note these are different artifacts and **not interchangeable**:
|
|
| 30 |
| | this repo | the demolition build |
|
| 31 |
|---|---|---|
|
| 32 |
| model | full 744B, unpruned | expert-pruned + LoRA-healed |
|
| 33 |
-
| size | ~384 GB (int4) | ~
|
| 34 |
| format | iliria container (`out-*.safetensors`) | MLX |
|
| 35 |
| runs on | iliria | MLX / mlx-lm |
|
| 36 |
|
|
|
|
| 8 |
- int4
|
| 9 |
- apple-silicon
|
| 10 |
- ssd-streaming
|
|
|
|
| 11 |
---
|
| 12 |
|
| 13 |
# GLM-5.2 — int4 container for iliria (full 744B, SSD-streamed)
|
| 14 |
|
| 15 |
+
[Explore the model guide](https://huggingface.co/spaces/philipjohnbasile/local-ai-guide) · [All public work](https://huggingface.co/philipjohnbasile)
|
| 16 |
+
|
| 17 |
+
## Release at a glance
|
| 18 |
+
|
| 19 |
+
| | This artifact |
|
| 20 |
+
|---|---|
|
| 21 |
+
| Purpose | The unpruned GLM 5.2 expert set in an int4 container with an int8 MTP head for the iliria engine. |
|
| 22 |
+
| Runtime | iliria streams experts from SSD. The documented setup is an Apple Silicon 128 GB machine with roughly 384 GB of weight storage. |
|
| 23 |
+
| Status | Recorded runtime; see the evidence and limits below. |
|
| 24 |
+
| Tensor download | 383.94 GB (357.57 GiB) of root `.safetensors` files, including any root sidecars. This is a file-size total, not peak RAM. |
|
| 25 |
+
| Read first | The on-disk payload is not resident RAM. These files are not interchangeable with the pruned MLX build; consult iliria for runtime limits. |
|
| 26 |
+
|
| 27 |
The **full** GLM-5.2 (744B total / 39B active) quantized to int4 with an int8 MTP head, packaged
|
| 28 |
as the container that [**iliria**](https://github.com/PhilipJohnBasile/iliria) serves directly.
|
| 29 |
|
|
|
|
| 41 |
| | this repo | the demolition build |
|
| 42 |
|---|---|---|
|
| 43 |
| model | full 744B, unpruned | expert-pruned + LoRA-healed |
|
| 44 |
+
| root tensor size | ~384 GB (int4) | ~105 GB / 98 GiB |
|
| 45 |
| format | iliria container (`out-*.safetensors`) | MLX |
|
| 46 |
| runs on | iliria | MLX / mlx-lm |
|
| 47 |
|