ManniX-ITA commited on
Commit
73f68fa
·
verified ·
1 Parent(s): 9db0ef2

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +9 -6
README.md CHANGED
@@ -55,16 +55,19 @@ relying on an opencoti feature elsewhere.
55
  |---|---|---|
56
  | `opencoti-llamafile-<ver>-<tag>-x86_64.llamafile` | x86_64 + aarch64 (fat APE; Linux/macOS/BSD) | CUDA 13.2 **embedded**, x86_64-linux (sm_75/80/86/89/90/120f) |
57
  | `opencoti-llamafile-<ver>-<tag>-win-x86_64.llamafile.exe` | same fat APE, incl. **Windows** | none embedded — CPU out of the box, GPU via side-load (below) |
 
58
  | `dso/<ver>-<tag>/ggml-cuda-x86_64.so` | side-load DSO for the `-win`/bare APE on x86_64-linux | CUDA 13.2, x86_64-linux (sm_75/80/86/89/90/120f) |
59
- | `opencoti-llamafile-<ver>-<tag>-aarch64.llamafile` *(planned)* | same fat APE | CUDA 13.2, sbsa/aarch64 (sm_110f Jetson Thor, sm_121a DGX Spark GB10) |
60
 
61
  The APE host binary is identical across variants and runs natively on
62
  both x86_64 and aarch64. The variants differ ONLY in the embedded
63
- `ggml-cuda.so`: the full x86_64 artifact carries it inside (4.8 GB);
64
- the `-win` variant carries none, because **Windows refuses to run
65
- executables larger than 4 GB**it is the same APE renamed `.exe`
66
- (required on Windows) at ~55 MB. With no matching DSO available,
67
- inference falls back to CPU.
 
 
68
 
69
  ## Usage
70
 
 
55
  |---|---|---|
56
  | `opencoti-llamafile-<ver>-<tag>-x86_64.llamafile` | x86_64 + aarch64 (fat APE; Linux/macOS/BSD) | CUDA 13.2 **embedded**, x86_64-linux (sm_75/80/86/89/90/120f) |
57
  | `opencoti-llamafile-<ver>-<tag>-win-x86_64.llamafile.exe` | same fat APE, incl. **Windows** | none embedded — CPU out of the box, GPU via side-load (below) |
58
+ | `opencoti-llamafile-<ver>-<tag>-aarch64.llamafile` | same fat APE | CUDA 13.2 **embedded**, sbsa/aarch64-linux (sm_110f DGX Spark GB10 / Jetson Thor, sm_121a) |
59
  | `dso/<ver>-<tag>/ggml-cuda-x86_64.so` | side-load DSO for the `-win`/bare APE on x86_64-linux | CUDA 13.2, x86_64-linux (sm_75/80/86/89/90/120f) |
60
+ | `dso/<ver>-<tag>/ggml-cuda-sbsa-aarch64.so` | side-load DSO for the `-win`/bare APE on aarch64-linux | CUDA 13.2, sbsa/aarch64-linux (sm_110f, sm_121a) |
61
 
62
  The APE host binary is identical across variants and runs natively on
63
  both x86_64 and aarch64. The variants differ ONLY in the embedded
64
+ `ggml-cuda.so`: the full x86_64 artifact carries the x86_64-linux DSO
65
+ (4.8 GB); the `-aarch64` artifact carries the sbsa/aarch64-linux DSO
66
+ (1.8 GB — GPU out of the box on DGX Spark-class hosts); the `-win`
67
+ variant carries none, because **Windows refuses to run executables
68
+ larger than 4 GB** — it is the same APE renamed `.exe` (required on
69
+ Windows) at ~55 MB. With no matching DSO available, inference falls
70
+ back to CPU.
71
 
72
  ## Usage
73