ManniX-ITA commited on
Commit
4e674e8
Β·
verified Β·
1 Parent(s): eb80e45

c3: release notes -win variant

Browse files
releases/llamafile-v0.10.3+opencoti.c3/RELEASE_NOTES.md CHANGED
@@ -9,22 +9,39 @@ engine (#613 lane). Built from
9
  Version string: `opencoti-0.10.3-c3` β€” printed by `--version` and exposed
10
  at runtime.
11
 
12
- ## Artifact
13
 
14
  | File | Size | sha256 |
15
  |---|---:|---|
16
  | `opencoti-llamafile-0.10.3-c3-x86_64.llamafile` | 4,812,296,839 B | `8a35b1f87b7bb7f2915d8756450f09008f4cd8331cf4a763e40edbcb8c4cf7e9` |
 
 
17
 
18
- Embedded `ggml-cuda.so`: 4,756,838,104 B, sha256
19
- `5e0342ba9b2ded4847280067dfd6ebc4257e1b83a984881988c528c163b23e4a`
20
- (glibc floor GLIBC_2.29 β€” runs on Debian 11 / glibc 2.31 and newer).
21
 
22
  Single-file Cosmopolitan APE. **Fat binary: runs natively on x86_64 and
23
  aarch64** (Linux/macOS/Windows/BSD) β€” on ARM64 hosts (DGX Spark, GH200,
24
- Apple Silicon) inference is CPU-only in this cut; the embedded CUDA DSO
25
- is x86_64-linux. GPU-enabled aarch64 (sbsa) is a planned separate
26
  artifact.
27
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
  Run as a server:
29
 
30
  ```bash
@@ -38,6 +55,12 @@ Without `--server` the binary starts the interactive chat CLI.
38
 
39
  ## What's new vs c2 (2026-07-05)
40
 
 
 
 
 
 
 
41
  **Host binary (patches 0122–0133):**
42
  - RYS `--repeat-layers` weight-shared layer duplication + `--rys-probe`
43
  v2 task battery (#656–#673)
 
9
  Version string: `opencoti-0.10.3-c3` β€” printed by `--version` and exposed
10
  at runtime.
11
 
12
+ ## Artifacts
13
 
14
  | File | Size | sha256 |
15
  |---|---:|---|
16
  | `opencoti-llamafile-0.10.3-c3-x86_64.llamafile` | 4,812,296,839 B | `8a35b1f87b7bb7f2915d8756450f09008f4cd8331cf4a763e40edbcb8c4cf7e9` |
17
+ | `opencoti-llamafile-0.10.3-c3-win-x86_64.llamafile.exe` | 55,429,522 B | `e5aa9a3d4e8274ca430f3a5557708955821cbc2d6d2c20f36a1c24228b0c642d` |
18
+ | `dso/0.10.3-c3/ggml-cuda-x86_64.so` (side-load DSO, HF only) | 4,756,838,104 B | `5e0342ba9b2ded4847280067dfd6ebc4257e1b83a984881988c528c163b23e4a` |
19
 
20
+ The main artifact's embedded `ggml-cuda.so` is byte-identical to the
21
+ standalone side-load DSO above (glibc floor GLIBC_2.29 β€” runs on
22
+ Debian 11 / glibc 2.31 and newer).
23
 
24
  Single-file Cosmopolitan APE. **Fat binary: runs natively on x86_64 and
25
  aarch64** (Linux/macOS/Windows/BSD) β€” on ARM64 hosts (DGX Spark, GH200,
26
+ Apple Silicon) inference is CPU-only in this cut; the CUDA DSO is
27
+ x86_64-linux. GPU-enabled aarch64 (sbsa) is a planned separate
28
  artifact.
29
 
30
+ ### `-win` variant
31
+
32
+ The full artifact cannot run on Windows: **Windows refuses to execute
33
+ binaries larger than 4 GB**. `…-win-x86_64.llamafile.exe` is the same
34
+ host APE (identical patches/features, `.exe` extension Windows
35
+ requires) with **no embedded GPU backend** β€” 55 MB, CPU inference out
36
+ of the box on Windows/Linux/macOS/BSD. GPU:
37
+
38
+ - **Windows:** install CUDA Toolkit + MSVC; llamafile compiles
39
+ `ggml-cuda.dll` on the fly on first `-ngl` run (upstream mechanism).
40
+ - **Linux x86_64:** side-load the standalone DSO:
41
+ `mkdir -p ~/.llamafile/v/0.10.3/ && cp ggml-cuda-x86_64.so
42
+ ~/.llamafile/v/0.10.3/ggml-cuda.so` (verify sha against
43
+ `SHA256SUMS` first).
44
+
45
  Run as a server:
46
 
47
  ```bash
 
55
 
56
  ## What's new vs c2 (2026-07-05)
57
 
58
+ **Packaging:**
59
+ - NEW `-win` variant (Windows-runnable bare APE, GPU via side-load)
60
+ + standalone side-load CUDA DSO published under `dso/` on HF
61
+ - Supported/target model families (Gemma-4 primary, Qwen secondary)
62
+ now documented prominently in README + USAGE
63
+
64
  **Host binary (patches 0122–0133):**
65
  - RYS `--repeat-layers` weight-shared layer duplication + `--rys-probe`
66
  v2 task battery (#656–#673)