ataeff commited on
Commit
0c9170d
·
1 Parent(s): af2475f

ears: Whisper tiny and base ggml weights beside the eye, with the phone-1 parity note

Browse files

Co-Authored-By: Claude (Arianna Method, Defender) <theariannamethod@gmail.com>
Coordinated with Oleg Ataeff (maintainer)

Files changed (4) hide show
  1. README.md +18 -0
  2. ears/SHA256SUMS.txt +2 -0
  3. ears/ggml-base.bin +3 -0
  4. ears/ggml-tiny.bin +3 -0
README.md CHANGED
@@ -55,3 +55,21 @@ objects from the description; Q6_K and Q8_0 reproduced the same sentence.
55
 
56
  Other VLMs as alternative eyes for the same organ are planned; they will land in
57
  sibling folders with the same measurement table.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
55
 
56
  Other VLMs as alternative eyes for the same organ are planned; they will land in
57
  sibling folders with the same measurement table.
58
+
59
+ ## ears/ — the hearing
60
+
61
+ `ears` is whisper on notorch: a C organ that loads OpenAI Whisper weights in
62
+ ggerganov's flat ggml format and transcribes 16 kHz mono wav with greedy decoding.
63
+ Its gate is parity with whisper.cpp: on phone-1 the log-mel is bit-identical, and
64
+ the transcripts of `jfk.wav` and of the same sentence re-recorded through the
65
+ phone microphone match token for token on both models below. Encoder outputs
66
+ differ by up to 4.9e-2 (mean 2.2e-4) because whisper.cpp keeps attention in f16.
67
+
68
+ | file | params | size | origin |
69
+ |---|---|---|---|
70
+ | `ggml-tiny.bin` | 39M, multilingual | 78 MB | OpenAI Whisper tiny, ggml conversion from whisper.cpp `models/download-ggml-model.sh` |
71
+ | `ggml-base.bin` | 74M, multilingual | 148 MB | OpenAI Whisper base, same |
72
+
73
+ Measured on phone-1, cores 4-7, four threads, `jfk.wav`: `ears` tiny 4.2 s wall,
74
+ 131 MB peak RSS. Whisper weights are MIT-licensed by OpenAI; `SHA256SUMS.txt`
75
+ in the folder lists both files.
ears/SHA256SUMS.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ 60ed5bc3dd14eea856493d334349b405782ddcaf0028d4b5df4088345fba2efe ggml-base.bin
2
+ be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21 ggml-tiny.bin
ears/ggml-base.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60ed5bc3dd14eea856493d334349b405782ddcaf0028d4b5df4088345fba2efe
3
+ size 147951465
ears/ggml-tiny.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21
3
+ size 77691713