jcbtc commited on
Commit
1e57c5b
Β·
verified Β·
1 Parent(s): eca5142

Add model card

Browse files
Files changed (1) hide show
  1. README.md +6 -31
README.md CHANGED
@@ -72,8 +72,7 @@ official Q4_K_M GGUF and reached **35.62 tokens/second** during the complete
72
 
73
  ## Runtime V3 patch notes
74
 
75
- Runtime V3 adds parser, grammar, and template portability fixes on top of the
76
- V2 Vulkan runtime:
77
 
78
  - ports [llama.cpp PR #24835](https://github.com/ggml-org/llama.cpp/pull/24835)
79
  so generated JSON values no longer carry trailing grammar whitespace that
@@ -81,19 +80,15 @@ V2 Vulkan runtime:
81
  - aligns PEG JSON-array comma whitespace handling with the generated grammar;
82
  - adds a Laguna/Pi regression for an `edit` call containing an
83
  `array<object>` argument and source-code strings;
84
- - removes the render-only `{% generation %}` extension from the Laguna S 2.1
85
- template, preserving the rendered prompt while allowing standard Jinja and
86
- MiniJinja engines such as Hipfire to parse it;
87
  - retains the V2 RADV DeviceLost safeguards and validated 128K defaults.
88
 
89
  Focused V3 validation on Ryzen AI Max+ 395 / Radeon 8060S with Mesa RADV
90
  26.1.2 passed JSON-schema grammar conversion, automatic parser selection, the
91
- nested Pi edit-call regression, the Laguna architecture test, and a strict
92
- standard-Jinja syntax parse. Real-model smokes returned `Paris.`, preserved the
93
- nested `edit` tool call, completed an 8,061-token functional smoke with the
94
- expected `omega` response, and released the slot after cancellation at 82% of
95
- a 15,000-token request. A follow-up request returned `Paris.` with no
96
- `VK_ERROR_DEVICE_LOST`.
97
 
98
  ### V2 Vulkan stability baseline
99
 
@@ -346,26 +341,6 @@ full-depth prefill, multi-turn, and cache-replay gates.
346
  The complete production recipe is preserved in the
347
  [ROCmFPX Laguna Runtime V3 guide](https://github.com/ciru-ai/ROCmFPX/blob/e4db35e027d0a9fa60e3324e4cc12f63ba7e0a00/docs/recipes/laguna-s21-chadrock-rocmfp4-strixkvspine-v4.md).
348
 
349
- ## Hipfire template compatibility
350
-
351
- Hipfire releases that do not implement the Hugging Face `{% generation %}`
352
- extension reject the older embedded template and fall back to raw-encoding the
353
- user text, which produces incoherent output. Runtime V3's Laguna template
354
- avoids that extension.
355
-
356
- For an existing `.mq4` with the older embedded template, run this from the
357
- ROCmFPX repository root to override it without re-quantizing the model:
358
-
359
- ```bash
360
- HIPFIRE_LOCAL=1 \
361
- HIPFIRE_CHAT_TEMPLATE_FILE="$PWD/models/templates/poolside-Laguna-S-2.1.jinja" \
362
- hipfire run ~/.hipfire/models/laguna-s21.mq4 --max-tokens 64 \
363
- "The capital of France is"
364
- ```
365
-
366
- If a background Hipfire daemon is already running, stop it with `hipfire stop`
367
- before testing without `HIPFIRE_LOCAL=1`.
368
-
369
  ## Example request
370
 
371
  After starting the compatible server:
 
72
 
73
  ## Runtime V3 patch notes
74
 
75
+ Runtime V3 adds parser and grammar fixes on top of the V2 Vulkan runtime:
 
76
 
77
  - ports [llama.cpp PR #24835](https://github.com/ggml-org/llama.cpp/pull/24835)
78
  so generated JSON values no longer carry trailing grammar whitespace that
 
80
  - aligns PEG JSON-array comma whitespace handling with the generated grammar;
81
  - adds a Laguna/Pi regression for an `edit` call containing an
82
  `array<object>` argument and source-code strings;
 
 
 
83
  - retains the V2 RADV DeviceLost safeguards and validated 128K defaults.
84
 
85
  Focused V3 validation on Ryzen AI Max+ 395 / Radeon 8060S with Mesa RADV
86
  26.1.2 passed JSON-schema grammar conversion, automatic parser selection, the
87
+ nested Pi edit-call regression, and the Laguna architecture test. Real-model
88
+ smokes returned `Paris.`, preserved the nested `edit` tool call, completed an
89
+ 8,061-token functional smoke with the expected `omega` response, and released
90
+ the slot after cancellation at 82% of a 15,000-token request. A follow-up
91
+ request returned `Paris.` with no `VK_ERROR_DEVICE_LOST`.
 
92
 
93
  ### V2 Vulkan stability baseline
94
 
 
341
  The complete production recipe is preserved in the
342
  [ROCmFPX Laguna Runtime V3 guide](https://github.com/ciru-ai/ROCmFPX/blob/e4db35e027d0a9fa60e3324e4cc12f63ba7e0a00/docs/recipes/laguna-s21-chadrock-rocmfp4-strixkvspine-v4.md).
343
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
344
  ## Example request
345
 
346
  After starting the compatible server: