c3: release notes -win variant
Browse files
releases/llamafile-v0.10.3+opencoti.c3/RELEASE_NOTES.md
CHANGED
|
@@ -9,22 +9,39 @@ engine (#613 lane). Built from
|
|
| 9 |
Version string: `opencoti-0.10.3-c3` β printed by `--version` and exposed
|
| 10 |
at runtime.
|
| 11 |
|
| 12 |
-
##
|
| 13 |
|
| 14 |
| File | Size | sha256 |
|
| 15 |
|---|---:|---|
|
| 16 |
| `opencoti-llamafile-0.10.3-c3-x86_64.llamafile` | 4,812,296,839 B | `8a35b1f87b7bb7f2915d8756450f09008f4cd8331cf4a763e40edbcb8c4cf7e9` |
|
|
|
|
|
|
|
| 17 |
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
|
| 22 |
Single-file Cosmopolitan APE. **Fat binary: runs natively on x86_64 and
|
| 23 |
aarch64** (Linux/macOS/Windows/BSD) β on ARM64 hosts (DGX Spark, GH200,
|
| 24 |
-
Apple Silicon) inference is CPU-only in this cut; the
|
| 25 |
-
|
| 26 |
artifact.
|
| 27 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
Run as a server:
|
| 29 |
|
| 30 |
```bash
|
|
@@ -38,6 +55,12 @@ Without `--server` the binary starts the interactive chat CLI.
|
|
| 38 |
|
| 39 |
## What's new vs c2 (2026-07-05)
|
| 40 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
**Host binary (patches 0122β0133):**
|
| 42 |
- RYS `--repeat-layers` weight-shared layer duplication + `--rys-probe`
|
| 43 |
v2 task battery (#656β#673)
|
|
|
|
| 9 |
Version string: `opencoti-0.10.3-c3` β printed by `--version` and exposed
|
| 10 |
at runtime.
|
| 11 |
|
| 12 |
+
## Artifacts
|
| 13 |
|
| 14 |
| File | Size | sha256 |
|
| 15 |
|---|---:|---|
|
| 16 |
| `opencoti-llamafile-0.10.3-c3-x86_64.llamafile` | 4,812,296,839 B | `8a35b1f87b7bb7f2915d8756450f09008f4cd8331cf4a763e40edbcb8c4cf7e9` |
|
| 17 |
+
| `opencoti-llamafile-0.10.3-c3-win-x86_64.llamafile.exe` | 55,429,522 B | `e5aa9a3d4e8274ca430f3a5557708955821cbc2d6d2c20f36a1c24228b0c642d` |
|
| 18 |
+
| `dso/0.10.3-c3/ggml-cuda-x86_64.so` (side-load DSO, HF only) | 4,756,838,104 B | `5e0342ba9b2ded4847280067dfd6ebc4257e1b83a984881988c528c163b23e4a` |
|
| 19 |
|
| 20 |
+
The main artifact's embedded `ggml-cuda.so` is byte-identical to the
|
| 21 |
+
standalone side-load DSO above (glibc floor GLIBC_2.29 β runs on
|
| 22 |
+
Debian 11 / glibc 2.31 and newer).
|
| 23 |
|
| 24 |
Single-file Cosmopolitan APE. **Fat binary: runs natively on x86_64 and
|
| 25 |
aarch64** (Linux/macOS/Windows/BSD) β on ARM64 hosts (DGX Spark, GH200,
|
| 26 |
+
Apple Silicon) inference is CPU-only in this cut; the CUDA DSO is
|
| 27 |
+
x86_64-linux. GPU-enabled aarch64 (sbsa) is a planned separate
|
| 28 |
artifact.
|
| 29 |
|
| 30 |
+
### `-win` variant
|
| 31 |
+
|
| 32 |
+
The full artifact cannot run on Windows: **Windows refuses to execute
|
| 33 |
+
binaries larger than 4 GB**. `β¦-win-x86_64.llamafile.exe` is the same
|
| 34 |
+
host APE (identical patches/features, `.exe` extension Windows
|
| 35 |
+
requires) with **no embedded GPU backend** β 55 MB, CPU inference out
|
| 36 |
+
of the box on Windows/Linux/macOS/BSD. GPU:
|
| 37 |
+
|
| 38 |
+
- **Windows:** install CUDA Toolkit + MSVC; llamafile compiles
|
| 39 |
+
`ggml-cuda.dll` on the fly on first `-ngl` run (upstream mechanism).
|
| 40 |
+
- **Linux x86_64:** side-load the standalone DSO:
|
| 41 |
+
`mkdir -p ~/.llamafile/v/0.10.3/ && cp ggml-cuda-x86_64.so
|
| 42 |
+
~/.llamafile/v/0.10.3/ggml-cuda.so` (verify sha against
|
| 43 |
+
`SHA256SUMS` first).
|
| 44 |
+
|
| 45 |
Run as a server:
|
| 46 |
|
| 47 |
```bash
|
|
|
|
| 55 |
|
| 56 |
## What's new vs c2 (2026-07-05)
|
| 57 |
|
| 58 |
+
**Packaging:**
|
| 59 |
+
- NEW `-win` variant (Windows-runnable bare APE, GPU via side-load)
|
| 60 |
+
+ standalone side-load CUDA DSO published under `dso/` on HF
|
| 61 |
+
- Supported/target model families (Gemma-4 primary, Qwen secondary)
|
| 62 |
+
now documented prominently in README + USAGE
|
| 63 |
+
|
| 64 |
**Host binary (patches 0122β0133):**
|
| 65 |
- RYS `--repeat-layers` weight-shared layer duplication + `--rys-probe`
|
| 66 |
v2 task battery (#656β#673)
|