Upload folder using huggingface_hub
Browse files
docs/features/llamafile_build.md
CHANGED
|
@@ -109,7 +109,7 @@ you're polishing a patch you haven't yet captured under
|
|
| 109 |
## `package` subcommand details
|
| 110 |
|
| 111 |
```
|
| 112 |
-
build:llamafile:package [--with-model PATH] [--with-args PATH] [--arch ID] [--cpu-only]
|
| 113 |
```
|
| 114 |
|
| 115 |
- `--with-model PATH` — GGUF to embed. Filename is preserved; the
|
|
@@ -124,6 +124,12 @@ build:llamafile:package [--with-model PATH] [--with-args PATH] [--arch ID] [--cp
|
|
| 124 |
- `--cpu-only` — skip embedding any DSO. Produces a binary that
|
| 125 |
works on any host but always runs on CPU. Useful for CI smoke
|
| 126 |
on machines with no GPU.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 127 |
|
| 128 |
Embedding uses the vendored zipalign at
|
| 129 |
`vendors/sources/llamafile/o/third_party/zipalign/zipalign`. For DSOs
|
|
|
|
| 109 |
## `package` subcommand details
|
| 110 |
|
| 111 |
```
|
| 112 |
+
build:llamafile:package [--with-model PATH] [--with-args PATH] [--arch ID] [--cpu-only] [--win-variant]
|
| 113 |
```
|
| 114 |
|
| 115 |
- `--with-model PATH` — GGUF to embed. Filename is preserved; the
|
|
|
|
| 124 |
- `--cpu-only` — skip embedding any DSO. Produces a binary that
|
| 125 |
works on any host but always runs on CPU. Useful for CI smoke
|
| 126 |
on machines with no GPU.
|
| 127 |
+
- `--win-variant` — package the bare thin APE (no embedded DSO) as
|
| 128 |
+
`…-win-x86_64.llamafile.exe` and hard-fail if it exceeds 4 GiB:
|
| 129 |
+
Windows refuses executables >4 GB, so this is the only variant
|
| 130 |
+
that can run there (CPU out of the box; GPU via side-load DSO on
|
| 131 |
+
Linux or llamafile's on-the-fly nvcc DLL compile on Windows).
|
| 132 |
+
MANIFEST records `arch: "win-x86_64"`, `backends: []`.
|
| 133 |
|
| 134 |
Embedding uses the vendored zipalign at
|
| 135 |
`vendors/sources/llamafile/o/third_party/zipalign/zipalign`. For DSOs
|