philipjohnbasile commited on
Commit
9768823
·
verified ·
1 Parent(s): f0764f0

Clarify release scope and connect the model portfolio

Browse files

Add model-guide navigation and evidence-scoped artifact information. Correct applicable links, size units, runtime status, or unsupported comparisons. Preserve weights and original evaluation receipts. Wisp refreshes only the README entry in its active export manifest.

Files changed (1) hide show
  1. README.md +13 -2
README.md CHANGED
@@ -8,11 +8,22 @@ tags:
8
  - int4
9
  - apple-silicon
10
  - ssd-streaming
11
- library_name: safetensors
12
  ---
13
 
14
  # GLM-5.2 — int4 container for iliria (full 744B, SSD-streamed)
15
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  The **full** GLM-5.2 (744B total / 39B active) quantized to int4 with an int8 MTP head, packaged
17
  as the container that [**iliria**](https://github.com/PhilipJohnBasile/iliria) serves directly.
18
 
@@ -30,7 +41,7 @@ note these are different artifacts and **not interchangeable**:
30
  | | this repo | the demolition build |
31
  |---|---|---|
32
  | model | full 744B, unpruned | expert-pruned + LoRA-healed |
33
- | size | ~384 GB (int4) | ~98 GB |
34
  | format | iliria container (`out-*.safetensors`) | MLX |
35
  | runs on | iliria | MLX / mlx-lm |
36
 
 
8
  - int4
9
  - apple-silicon
10
  - ssd-streaming
 
11
  ---
12
 
13
  # GLM-5.2 — int4 container for iliria (full 744B, SSD-streamed)
14
 
15
+ [Explore the model guide](https://huggingface.co/spaces/philipjohnbasile/local-ai-guide) · [All public work](https://huggingface.co/philipjohnbasile)
16
+
17
+ ## Release at a glance
18
+
19
+ | | This artifact |
20
+ |---|---|
21
+ | Purpose | The unpruned GLM 5.2 expert set in an int4 container with an int8 MTP head for the iliria engine. |
22
+ | Runtime | iliria streams experts from SSD. The documented setup is an Apple Silicon 128 GB machine with roughly 384 GB of weight storage. |
23
+ | Status | Recorded runtime; see the evidence and limits below. |
24
+ | Tensor download | 383.94 GB (357.57 GiB) of root `.safetensors` files, including any root sidecars. This is a file-size total, not peak RAM. |
25
+ | Read first | The on-disk payload is not resident RAM. These files are not interchangeable with the pruned MLX build; consult iliria for runtime limits. |
26
+
27
  The **full** GLM-5.2 (744B total / 39B active) quantized to int4 with an int8 MTP head, packaged
28
  as the container that [**iliria**](https://github.com/PhilipJohnBasile/iliria) serves directly.
29
 
 
41
  | | this repo | the demolition build |
42
  |---|---|---|
43
  | model | full 744B, unpruned | expert-pruned + LoRA-healed |
44
+ | root tensor size | ~384 GB (int4) | ~105 GB / 98 GiB |
45
  | format | iliria container (`out-*.safetensors`) | MLX |
46
  | runs on | iliria | MLX / mlx-lm |
47