jcbtc commited on
Commit
782316d
Β·
verified Β·
1 Parent(s): 1e57c5b

Add model card

Browse files
Files changed (1) hide show
  1. README.md +25 -7
README.md CHANGED
@@ -42,8 +42,8 @@ official Q4_K_M GGUF and reached **35.62 tokens/second** during the complete
42
  > [!IMPORTANT]
43
  > This GGUF uses ROCmFP4 tensor types and Laguna architecture support. It is
44
  > built for the Laguna-enabled
45
- > [Ciru ROCmFPX Runtime V3](https://github.com/ciru-ai/ROCmFPX/tree/e4db35e027d0a9fa60e3324e4cc12f63ba7e0a00)
46
- > at commit `e4db35e027d0a9fa60e3324e4cc12f63ba7e0a00`. It does not load in
47
  > stock upstream llama.cpp.
48
  >
49
  > Runtime V3 fixes Laguna tool-call grammar/parser agreement and removes a
@@ -80,6 +80,10 @@ Runtime V3 adds parser and grammar fixes on top of the V2 Vulkan runtime:
80
  - aligns PEG JSON-array comma whitespace handling with the generated grammar;
81
  - adds a Laguna/Pi regression for an `edit` call containing an
82
  `array<object>` argument and source-code strings;
 
 
 
 
83
  - retains the V2 RADV DeviceLost safeguards and validated 128K defaults.
84
 
85
  Focused V3 validation on Ryzen AI Max+ 395 / Radeon 8060S with Mesa RADV
@@ -90,6 +94,13 @@ smokes returned `Paris.`, preserved the nested `edit` tool call, completed an
90
  the slot after cancellation at 82% of a 15,000-token request. A follow-up
91
  request returned `Paris.` with no `VK_ERROR_DEVICE_LOST`.
92
 
 
 
 
 
 
 
 
93
  ### V2 Vulkan stability baseline
94
 
95
  The first runtime release could lose the Vulkan device during a very deep
@@ -209,9 +220,9 @@ Clone and pin Runtime V3 exactly:
209
  git clone --branch agent/laguna-s21-runtime-v3 --depth 1 \
210
  https://github.com/ciru-ai/ROCmFPX.git
211
  cd ROCmFPX
212
- git checkout --detach e4db35e027d0a9fa60e3324e4cc12f63ba7e0a00
213
  test "$(git rev-parse HEAD)" = \
214
- "e4db35e027d0a9fa60e3324e4cc12f63ba7e0a00"
215
  ```
216
 
217
  The distro-aware helper prints the native package command before making any
@@ -285,7 +296,7 @@ build-laguna-strix-vulkan/bin/test-llama-archs
285
  ```
286
 
287
  The
288
- [complete Linux and V3 guide](https://github.com/ciru-ai/ROCmFPX/blob/e4db35e027d0a9fa60e3324e4cc12f63ba7e0a00/docs/recipes/laguna-s21-chadrock-rocmfp4-strixkvspine-v4.md)
289
  contains the Fedora, Arch, and NixOS commands.
290
 
291
  ### Start Laguna with the validated 128K V3 profile
@@ -301,7 +312,7 @@ scripts/run-laguna-vulkan-supervised.sh \
301
  The launcher applies the measured single-slot Strix Halo configuration:
302
  Vulkan0, full offload, row split, Flash Attention, 131,072 context, F16/F16
303
  KV, batch 2048, ubatch 512, node cap 10, FA dispatch width 4, 16 threads,
304
- thinking off, and this sampler:
305
 
306
  ```json
307
  {
@@ -327,6 +338,13 @@ The direct runner uses the same V3 safe defaults without supervision:
327
  scripts/run-laguna-s21-rocmfp4-v4.sh /path/to/model.gguf
328
  ```
329
 
 
 
 
 
 
 
 
330
  The model's 256K capacity remains available only as an explicit experimental
331
  lane:
332
 
@@ -339,7 +357,7 @@ That command prints a warning because 256K has not yet passed the
339
  full-depth prefill, multi-turn, and cache-replay gates.
340
 
341
  The complete production recipe is preserved in the
342
- [ROCmFPX Laguna Runtime V3 guide](https://github.com/ciru-ai/ROCmFPX/blob/e4db35e027d0a9fa60e3324e4cc12f63ba7e0a00/docs/recipes/laguna-s21-chadrock-rocmfp4-strixkvspine-v4.md).
343
 
344
  ## Example request
345
 
 
42
  > [!IMPORTANT]
43
  > This GGUF uses ROCmFP4 tensor types and Laguna architecture support. It is
44
  > built for the Laguna-enabled
45
+ > [Ciru ROCmFPX Runtime V3](https://github.com/ciru-ai/ROCmFPX/tree/54f5fe06c74350fb8b6aec21d8749071bc195bdb)
46
+ > at commit `54f5fe06c74350fb8b6aec21d8749071bc195bdb`. It does not load in
47
  > stock upstream llama.cpp.
48
  >
49
  > Runtime V3 fixes Laguna tool-call grammar/parser agreement and removes a
 
80
  - aligns PEG JSON-array comma whitespace handling with the generated grammar;
81
  - adds a Laguna/Pi regression for an `edit` call containing an
82
  `array<object>` argument and source-code strings;
83
+ - keeps server checkpoints host-backed, preventing the on-device checkpoint
84
+ destruction fault seen when a long hybrid/SWA context is invalidated;
85
+ - explicitly disables context checkpoints in the validated Laguna launcher
86
+ while leaving the normal KV and prompt caches available;
87
  - retains the V2 RADV DeviceLost safeguards and validated 128K defaults.
88
 
89
  Focused V3 validation on Ryzen AI Max+ 395 / Radeon 8060S with Mesa RADV
 
94
  the slot after cancellation at 82% of a 15,000-token request. A follow-up
95
  request returned `Paris.` with no `VK_ERROR_DEVICE_LOST`.
96
 
97
+ The checkpoint repair was exercised separately with checkpoints explicitly
98
+ re-enabled and prompt-cache RAM left at 8192 MiB. A 120,045-token request
99
+ created 16 hybrid/SWA checkpoints; an unrelated follow-up forced `pos_next=0`
100
+ and erased all 16, then returned `OK.`. The server remained healthy and shut
101
+ down cleanly without a core dump. Checkpoints nevertheless remain disabled in
102
+ the public profile until this gate is repeated across multi-turn workloads.
103
+
104
  ### V2 Vulkan stability baseline
105
 
106
  The first runtime release could lose the Vulkan device during a very deep
 
220
  git clone --branch agent/laguna-s21-runtime-v3 --depth 1 \
221
  https://github.com/ciru-ai/ROCmFPX.git
222
  cd ROCmFPX
223
+ git checkout --detach 54f5fe06c74350fb8b6aec21d8749071bc195bdb
224
  test "$(git rev-parse HEAD)" = \
225
+ "54f5fe06c74350fb8b6aec21d8749071bc195bdb"
226
  ```
227
 
228
  The distro-aware helper prints the native package command before making any
 
296
  ```
297
 
298
  The
299
+ [complete Linux and V3 guide](https://github.com/ciru-ai/ROCmFPX/blob/54f5fe06c74350fb8b6aec21d8749071bc195bdb/docs/recipes/laguna-s21-chadrock-rocmfp4-strixkvspine-v4.md)
300
  contains the Fedora, Arch, and NixOS commands.
301
 
302
  ### Start Laguna with the validated 128K V3 profile
 
312
  The launcher applies the measured single-slot Strix Halo configuration:
313
  Vulkan0, full offload, row split, Flash Attention, 131,072 context, F16/F16
314
  KV, batch 2048, ubatch 512, node cap 10, FA dispatch width 4, 16 threads,
315
+ thinking off, context checkpoints disabled, and this sampler:
316
 
317
  ```json
318
  {
 
338
  scripts/run-laguna-s21-rocmfp4-v4.sh /path/to/model.gguf
339
  ```
340
 
341
+ Context checkpoints are separate from the normal KV cache. The launcher now
342
+ passes `--ctx-checkpoints 0` because the hybrid/SWA checkpoint path has not yet
343
+ completed the full repeated 128K multi-turn and cache-replay qualification.
344
+ The runtime also moves checkpoint payloads back to host memory, matching the
345
+ safer upstream design. Advanced diagnostic runs can opt in with
346
+ `CTX_CHECKPOINTS=N`; this is not part of the validated public profile yet.
347
+
348
  The model's 256K capacity remains available only as an explicit experimental
349
  lane:
350
 
 
357
  full-depth prefill, multi-turn, and cache-replay gates.
358
 
359
  The complete production recipe is preserved in the
360
+ [ROCmFPX Laguna Runtime V3 guide](https://github.com/ciru-ai/ROCmFPX/blob/54f5fe06c74350fb8b6aec21d8749071bc195bdb/docs/recipes/laguna-s21-chadrock-rocmfp4-strixkvspine-v4.md).
361
 
362
  ## Example request
363