Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -55,16 +55,19 @@ relying on an opencoti feature elsewhere.
|
|
| 55 |
|---|---|---|
|
| 56 |
| `opencoti-llamafile-<ver>-<tag>-x86_64.llamafile` | x86_64 + aarch64 (fat APE; Linux/macOS/BSD) | CUDA 13.2 **embedded**, x86_64-linux (sm_75/80/86/89/90/120f) |
|
| 57 |
| `opencoti-llamafile-<ver>-<tag>-win-x86_64.llamafile.exe` | same fat APE, incl. **Windows** | none embedded — CPU out of the box, GPU via side-load (below) |
|
|
|
|
| 58 |
| `dso/<ver>-<tag>/ggml-cuda-x86_64.so` | side-load DSO for the `-win`/bare APE on x86_64-linux | CUDA 13.2, x86_64-linux (sm_75/80/86/89/90/120f) |
|
| 59 |
-
| `
|
| 60 |
|
| 61 |
The APE host binary is identical across variants and runs natively on
|
| 62 |
both x86_64 and aarch64. The variants differ ONLY in the embedded
|
| 63 |
-
`ggml-cuda.so`: the full x86_64 artifact carries
|
| 64 |
-
the `-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
|
|
|
|
|
|
| 68 |
|
| 69 |
## Usage
|
| 70 |
|
|
|
|
| 55 |
|---|---|---|
|
| 56 |
| `opencoti-llamafile-<ver>-<tag>-x86_64.llamafile` | x86_64 + aarch64 (fat APE; Linux/macOS/BSD) | CUDA 13.2 **embedded**, x86_64-linux (sm_75/80/86/89/90/120f) |
|
| 57 |
| `opencoti-llamafile-<ver>-<tag>-win-x86_64.llamafile.exe` | same fat APE, incl. **Windows** | none embedded — CPU out of the box, GPU via side-load (below) |
|
| 58 |
+
| `opencoti-llamafile-<ver>-<tag>-aarch64.llamafile` | same fat APE | CUDA 13.2 **embedded**, sbsa/aarch64-linux (sm_110f DGX Spark GB10 / Jetson Thor, sm_121a) |
|
| 59 |
| `dso/<ver>-<tag>/ggml-cuda-x86_64.so` | side-load DSO for the `-win`/bare APE on x86_64-linux | CUDA 13.2, x86_64-linux (sm_75/80/86/89/90/120f) |
|
| 60 |
+
| `dso/<ver>-<tag>/ggml-cuda-sbsa-aarch64.so` | side-load DSO for the `-win`/bare APE on aarch64-linux | CUDA 13.2, sbsa/aarch64-linux (sm_110f, sm_121a) |
|
| 61 |
|
| 62 |
The APE host binary is identical across variants and runs natively on
|
| 63 |
both x86_64 and aarch64. The variants differ ONLY in the embedded
|
| 64 |
+
`ggml-cuda.so`: the full x86_64 artifact carries the x86_64-linux DSO
|
| 65 |
+
(4.8 GB); the `-aarch64` artifact carries the sbsa/aarch64-linux DSO
|
| 66 |
+
(1.8 GB — GPU out of the box on DGX Spark-class hosts); the `-win`
|
| 67 |
+
variant carries none, because **Windows refuses to run executables
|
| 68 |
+
larger than 4 GB** — it is the same APE renamed `.exe` (required on
|
| 69 |
+
Windows) at ~55 MB. With no matching DSO available, inference falls
|
| 70 |
+
back to CPU.
|
| 71 |
|
| 72 |
## Usage
|
| 73 |
|