cjpais commited on
Commit
3370d4e
·
verified ·
1 Parent(s): 3dbedf8

Update model card: add transcribe_cpp metadata block (raw WER/RTF + capabilities)

Browse files
Files changed (1) hide show
  1. README.md +20 -3
README.md CHANGED
@@ -17,6 +17,24 @@ tags:
17
  - audio-llm
18
  - fastconformer
19
  - qwen3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  ---
21
 
22
  # canary-qwen-2.5b: transcribe.cpp GGUF
@@ -60,9 +78,8 @@ GGUF presets land at exactly 1.63% (`+0.02` over our reference run,
60
  same CI band). Investigation of the worst per-utterance differences
61
  shows scattered token-level noise consistent with BF16 weight
62
  precision (homophones, word-boundary flips, function-word
63
- substitutions); see the transcribe.cpp model page for the full
64
- teacher-forced logit comparison. Reproduce with `scripts/wer/run.py`
65
- + `scripts/wer/score.py`.
66
 
67
 
68
  ## Usage
 
17
  - audio-llm
18
  - fastconformer
19
  - qwen3
20
+ transcribe_cpp:
21
+ wer_librispeech_test_clean:
22
+ bf16: 1.63
23
+ f16: 1.63
24
+ q8_0: 1.63
25
+ q6_k: 1.63
26
+ q5_k_m: 1.63
27
+ q4_k_m: 1.63
28
+ rtf_m4_max:
29
+ metal: 39.8
30
+ cpu: 7.3
31
+ rtf_ryzen_4750u:
32
+ vulkan: 4.1
33
+ cpu: 2.1
34
+ streaming: false
35
+ translate: false
36
+ lang_detect: false
37
+ timestamps: none
38
  ---
39
 
40
  # canary-qwen-2.5b: transcribe.cpp GGUF
 
78
  same CI band). Investigation of the worst per-utterance differences
79
  shows scattered token-level noise consistent with BF16 weight
80
  precision (homophones, word-boundary flips, function-word
81
+ substitutions). Reproduce with `scripts/wer/run.py` +
82
+ `scripts/wer/score.py`.
 
83
 
84
 
85
  ## Usage