Davidsamuel101 commited on
Commit
bc351b2
·
verified ·
1 Parent(s): e2cd16c

Retire legacy dataset references

Browse files
README.md CHANGED
@@ -27,7 +27,7 @@ The included Icefall inference script retains its upstream Apache-2.0 source-cod
27
 
28
  ## Training data
29
 
30
- - [Common Voice 23.0 Spanish](https://datacollective.mozillafoundation.org/datasets/cmflnuzw51ddgmwjkxpm9z1lw), CC0-1.0.
31
  - [OpenSLR72 Colombian Spanish](https://www.openslr.org/72/), CC BY-SA 4.0.
32
  - [TinyVox Spanish](https://talkbank.org/phon/access/Derived/TinyVox.html), CC BY-NC-SA 3.0; source-hosted only.
33
 
@@ -169,13 +169,20 @@ is an explicit source-reproducibility limit rather than a claim that current
169
  The two public companion datasets expose the accepted Common Voice and SLR72
170
  rows, but exact training additionally requires:
171
 
172
- - the pinned full source repositories `bookbot/common_voice_23_0_es` at
173
- `591a99e9c5c9e308231746c7baa03eadfe670483` and
174
- `bookbot/slr72_dataset` at
175
- `e7c9924b964eecbdcba1181add860367d3c7ca3a`;
 
176
  - an existing verified Common Voice/SLR72 Lhotse fbank store;
177
  - locally obtained TinyVox Spanish data and the licensed alignment lexicon.
178
 
 
 
 
 
 
 
179
  TinyVox is not redistributed here. Obtain it from TalkBank and comply with
180
  CC BY-NC-SA 3.0 and the TalkBank Ground Rules. With those prerequisites, the
181
  historical preparation stages are:
 
27
 
28
  ## Training data
29
 
30
+ - [Common Voice 23.0 Spanish](https://mozilladatacollective.com/datasets/cmj8u3pe600fhnxxbqol7x8bg), CC0-1.0.
31
  - [OpenSLR72 Colombian Spanish](https://www.openslr.org/72/), CC BY-SA 4.0.
32
  - [TinyVox Spanish](https://talkbank.org/phon/access/Derived/TinyVox.html), CC BY-NC-SA 3.0; source-hosted only.
33
 
 
169
  The two public companion datasets expose the accepted Common Voice and SLR72
170
  rows, but exact training additionally requires:
171
 
172
+ - pinned full-source snapshots obtained from
173
+ [Mozilla Data Collective](https://mozilladatacollective.com/datasets/cmj8u3pe600fhnxxbqol7x8bg)
174
+ and [OpenSLR72](https://www.openslr.org/72/), identified by historical
175
+ preparation revisions `591a99e9c5c9e308231746c7baa03eadfe670483` and
176
+ `e7c9924b964eecbdcba1181add860367d3c7ca3a`, respectively;
177
  - an existing verified Common Voice/SLR72 Lhotse fbank store;
178
  - locally obtained TinyVox Spanish data and the licensed alignment lexicon.
179
 
180
+ Bookbot no longer hosts those full historical source snapshots. Exact
181
+ preparation therefore requires preserved local copies matching the recorded
182
+ revision and manifest hashes. The versioned IPA datasets above contain only
183
+ accepted final cuts and cannot replace the larger full-source inputs in this
184
+ historical preparation command.
185
+
186
  TinyVox is not redistributed here. Obtain it from TalkBank and comply with
187
  CC BY-NC-SA 3.0 and the TalkBank Ground Rules. With those prerequisites, the
188
  historical preparation stages are:
SHA256SUMS CHANGED
@@ -1,5 +1,5 @@
1
  1301f5da1d189f21124a38b721bb9be7b3ba5d8ddacd7b9da4fbe5777cabfddf .gitattributes
2
- 95292c575186406d589c4d9736a5257db87e07f5f8fb4feca4062fd7e794df8c README.md
3
  e6704a4c639f94e7361fb07d6fac698d3ea0c67d8f3eecef4ad6c0423013b646 epoch-80.pt
4
  d5cde97d82c214da39c3d9decffa84eaf6b15869c7b6521d2f184a2e59ad30e5 evaluated-avg-76-80.pt
5
  a0e2c1f3d0328595288a2faff77d1adfd30fa5070a61ed869091f643f593e377 jit_script_chunk_16_left_128.pt
@@ -15,7 +15,7 @@ cac4637b2c4844ea18624eed6676c8ba84cdd1135ca4b397cef5b97600db3b82 data/lang_phon
15
  df966241e868574effd699220a9a152127299e597a84fc4aef8f8dcd85598317 data/lang_phone/words.txt
16
  d9b7ab428ce395ae446f5aa5a8aba4f61ba0b41013da487a780249eec23f95f7 test_waves/README.txt
17
  4b3a5651a9df2b796904239873f23799ed0fe90e9b9fe511feb47288b7c21c86 test_waves/common_voice_es_19696062.wav
18
- a0ab749b25614da7fa59ea1c3cf1174096c39ccc067959d2533ab4100622dad6 streaming/evaluation-common-voice-23-0-es-slr72.json
19
  bef68d78a9602160c97c123f5c974bc4784553afafb60cfd7c28826115ed51d7 tensorboard/events.out.tfevents.1790163322.Bookbot-GPU1.1704718.0
20
  66723a421beddb1c2215e5da6fd265e6547265be30242f229893ab0f092789fa log/log-train-2026-09-23-21-35-22-0
21
  32b940810543686bd00454fa29a56075039a26c6022f8e7a4a42a1989c60579d log/log-train-2026-09-23-21-35-22-1
 
1
  1301f5da1d189f21124a38b721bb9be7b3ba5d8ddacd7b9da4fbe5777cabfddf .gitattributes
2
+ 7798701a64d866f716cbfae7f29cd5881c19d865b9352e730a0f37d9a41928a4 README.md
3
  e6704a4c639f94e7361fb07d6fac698d3ea0c67d8f3eecef4ad6c0423013b646 epoch-80.pt
4
  d5cde97d82c214da39c3d9decffa84eaf6b15869c7b6521d2f184a2e59ad30e5 evaluated-avg-76-80.pt
5
  a0e2c1f3d0328595288a2faff77d1adfd30fa5070a61ed869091f643f593e377 jit_script_chunk_16_left_128.pt
 
15
  df966241e868574effd699220a9a152127299e597a84fc4aef8f8dcd85598317 data/lang_phone/words.txt
16
  d9b7ab428ce395ae446f5aa5a8aba4f61ba0b41013da487a780249eec23f95f7 test_waves/README.txt
17
  4b3a5651a9df2b796904239873f23799ed0fe90e9b9fe511feb47288b7c21c86 test_waves/common_voice_es_19696062.wav
18
+ 0773be57c5f3673b5d17ab777244f49fa19e358500e7f27f155b26bca3c41147 streaming/evaluation-common-voice-23-0-es-slr72.json
19
  bef68d78a9602160c97c123f5c974bc4784553afafb60cfd7c28826115ed51d7 tensorboard/events.out.tfevents.1790163322.Bookbot-GPU1.1704718.0
20
  66723a421beddb1c2215e5da6fd265e6547265be30242f229893ab0f092789fa log/log-train-2026-09-23-21-35-22-0
21
  32b940810543686bd00454fa29a56075039a26c6022f8e7a4a42a1989c60579d log/log-train-2026-09-23-21-35-22-1
streaming/evaluation-common-voice-23-0-es-slr72.json CHANGED
@@ -16,7 +16,7 @@
16
  },
17
  "corpora": {
18
  "common_voice_23_0_es_test": {
19
- "source_manifest": "hf://datasets/bookbot/common_voice_23_0_es/manifest.tsv",
20
  "source_manifest_sha256": "ca5e485fd427ca33802293a228b534e1ebb0a14e6f7187bf04f51dc56702d35c",
21
  "preparation_revision": "591a99e9c5c9e308231746c7baa03eadfe670483",
22
  "source_test_rows": 15893,
@@ -29,7 +29,7 @@
29
  "overlap_note": "This official test split is reused by the recipe for validation."
30
  },
31
  "slr72_test": {
32
- "source_manifest": "hf://datasets/bookbot/slr72_dataset/manifest.tsv",
33
  "source_manifest_sha256": "fda09e2a168617d6eebabe6553b93ee0b6cce654d26e050cb3482b41718c7d27",
34
  "preparation_revision": "e7c9924b964eecbdcba1181add860367d3c7ca3a",
35
  "source_test_rows": 981,
 
16
  },
17
  "corpora": {
18
  "common_voice_23_0_es_test": {
19
+ "source_distribution": "https://mozilladatacollective.com/datasets/cmj8u3pe600fhnxxbqol7x8bg",
20
  "source_manifest_sha256": "ca5e485fd427ca33802293a228b534e1ebb0a14e6f7187bf04f51dc56702d35c",
21
  "preparation_revision": "591a99e9c5c9e308231746c7baa03eadfe670483",
22
  "source_test_rows": 15893,
 
29
  "overlap_note": "This official test split is reused by the recipe for validation."
30
  },
31
  "slr72_test": {
32
+ "source_distribution": "https://www.openslr.org/72/",
33
  "source_manifest_sha256": "fda09e2a168617d6eebabe6553b93ee0b6cce654d26e050cb3482b41718c7d27",
34
  "preparation_revision": "e7c9924b964eecbdcba1181add860367d3c7ca3a",
35
  "source_test_rows": 981,