Retire legacy dataset references
Browse files- README.md +12 -5
- SHA256SUMS +2 -2
- streaming/evaluation-common-voice-23-0-es-slr72.json +2 -2
README.md
CHANGED
|
@@ -27,7 +27,7 @@ The included Icefall inference script retains its upstream Apache-2.0 source-cod
|
|
| 27 |
|
| 28 |
## Training data
|
| 29 |
|
| 30 |
-
- [Common Voice 23.0 Spanish](https://
|
| 31 |
- [OpenSLR72 Colombian Spanish](https://www.openslr.org/72/), CC BY-SA 4.0.
|
| 32 |
- [TinyVox Spanish](https://talkbank.org/phon/access/Derived/TinyVox.html), CC BY-NC-SA 3.0; source-hosted only.
|
| 33 |
|
|
@@ -169,13 +169,20 @@ is an explicit source-reproducibility limit rather than a claim that current
|
|
| 169 |
The two public companion datasets expose the accepted Common Voice and SLR72
|
| 170 |
rows, but exact training additionally requires:
|
| 171 |
|
| 172 |
-
-
|
| 173 |
-
|
| 174 |
-
|
| 175 |
-
`
|
|
|
|
| 176 |
- an existing verified Common Voice/SLR72 Lhotse fbank store;
|
| 177 |
- locally obtained TinyVox Spanish data and the licensed alignment lexicon.
|
| 178 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 179 |
TinyVox is not redistributed here. Obtain it from TalkBank and comply with
|
| 180 |
CC BY-NC-SA 3.0 and the TalkBank Ground Rules. With those prerequisites, the
|
| 181 |
historical preparation stages are:
|
|
|
|
| 27 |
|
| 28 |
## Training data
|
| 29 |
|
| 30 |
+
- [Common Voice 23.0 Spanish](https://mozilladatacollective.com/datasets/cmj8u3pe600fhnxxbqol7x8bg), CC0-1.0.
|
| 31 |
- [OpenSLR72 Colombian Spanish](https://www.openslr.org/72/), CC BY-SA 4.0.
|
| 32 |
- [TinyVox Spanish](https://talkbank.org/phon/access/Derived/TinyVox.html), CC BY-NC-SA 3.0; source-hosted only.
|
| 33 |
|
|
|
|
| 169 |
The two public companion datasets expose the accepted Common Voice and SLR72
|
| 170 |
rows, but exact training additionally requires:
|
| 171 |
|
| 172 |
+
- pinned full-source snapshots obtained from
|
| 173 |
+
[Mozilla Data Collective](https://mozilladatacollective.com/datasets/cmj8u3pe600fhnxxbqol7x8bg)
|
| 174 |
+
and [OpenSLR72](https://www.openslr.org/72/), identified by historical
|
| 175 |
+
preparation revisions `591a99e9c5c9e308231746c7baa03eadfe670483` and
|
| 176 |
+
`e7c9924b964eecbdcba1181add860367d3c7ca3a`, respectively;
|
| 177 |
- an existing verified Common Voice/SLR72 Lhotse fbank store;
|
| 178 |
- locally obtained TinyVox Spanish data and the licensed alignment lexicon.
|
| 179 |
|
| 180 |
+
Bookbot no longer hosts those full historical source snapshots. Exact
|
| 181 |
+
preparation therefore requires preserved local copies matching the recorded
|
| 182 |
+
revision and manifest hashes. The versioned IPA datasets above contain only
|
| 183 |
+
accepted final cuts and cannot replace the larger full-source inputs in this
|
| 184 |
+
historical preparation command.
|
| 185 |
+
|
| 186 |
TinyVox is not redistributed here. Obtain it from TalkBank and comply with
|
| 187 |
CC BY-NC-SA 3.0 and the TalkBank Ground Rules. With those prerequisites, the
|
| 188 |
historical preparation stages are:
|
SHA256SUMS
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
1301f5da1d189f21124a38b721bb9be7b3ba5d8ddacd7b9da4fbe5777cabfddf .gitattributes
|
| 2 |
-
|
| 3 |
e6704a4c639f94e7361fb07d6fac698d3ea0c67d8f3eecef4ad6c0423013b646 epoch-80.pt
|
| 4 |
d5cde97d82c214da39c3d9decffa84eaf6b15869c7b6521d2f184a2e59ad30e5 evaluated-avg-76-80.pt
|
| 5 |
a0e2c1f3d0328595288a2faff77d1adfd30fa5070a61ed869091f643f593e377 jit_script_chunk_16_left_128.pt
|
|
@@ -15,7 +15,7 @@ cac4637b2c4844ea18624eed6676c8ba84cdd1135ca4b397cef5b97600db3b82 data/lang_phon
|
|
| 15 |
df966241e868574effd699220a9a152127299e597a84fc4aef8f8dcd85598317 data/lang_phone/words.txt
|
| 16 |
d9b7ab428ce395ae446f5aa5a8aba4f61ba0b41013da487a780249eec23f95f7 test_waves/README.txt
|
| 17 |
4b3a5651a9df2b796904239873f23799ed0fe90e9b9fe511feb47288b7c21c86 test_waves/common_voice_es_19696062.wav
|
| 18 |
-
|
| 19 |
bef68d78a9602160c97c123f5c974bc4784553afafb60cfd7c28826115ed51d7 tensorboard/events.out.tfevents.1790163322.Bookbot-GPU1.1704718.0
|
| 20 |
66723a421beddb1c2215e5da6fd265e6547265be30242f229893ab0f092789fa log/log-train-2026-09-23-21-35-22-0
|
| 21 |
32b940810543686bd00454fa29a56075039a26c6022f8e7a4a42a1989c60579d log/log-train-2026-09-23-21-35-22-1
|
|
|
|
| 1 |
1301f5da1d189f21124a38b721bb9be7b3ba5d8ddacd7b9da4fbe5777cabfddf .gitattributes
|
| 2 |
+
7798701a64d866f716cbfae7f29cd5881c19d865b9352e730a0f37d9a41928a4 README.md
|
| 3 |
e6704a4c639f94e7361fb07d6fac698d3ea0c67d8f3eecef4ad6c0423013b646 epoch-80.pt
|
| 4 |
d5cde97d82c214da39c3d9decffa84eaf6b15869c7b6521d2f184a2e59ad30e5 evaluated-avg-76-80.pt
|
| 5 |
a0e2c1f3d0328595288a2faff77d1adfd30fa5070a61ed869091f643f593e377 jit_script_chunk_16_left_128.pt
|
|
|
|
| 15 |
df966241e868574effd699220a9a152127299e597a84fc4aef8f8dcd85598317 data/lang_phone/words.txt
|
| 16 |
d9b7ab428ce395ae446f5aa5a8aba4f61ba0b41013da487a780249eec23f95f7 test_waves/README.txt
|
| 17 |
4b3a5651a9df2b796904239873f23799ed0fe90e9b9fe511feb47288b7c21c86 test_waves/common_voice_es_19696062.wav
|
| 18 |
+
0773be57c5f3673b5d17ab777244f49fa19e358500e7f27f155b26bca3c41147 streaming/evaluation-common-voice-23-0-es-slr72.json
|
| 19 |
bef68d78a9602160c97c123f5c974bc4784553afafb60cfd7c28826115ed51d7 tensorboard/events.out.tfevents.1790163322.Bookbot-GPU1.1704718.0
|
| 20 |
66723a421beddb1c2215e5da6fd265e6547265be30242f229893ab0f092789fa log/log-train-2026-09-23-21-35-22-0
|
| 21 |
32b940810543686bd00454fa29a56075039a26c6022f8e7a4a42a1989c60579d log/log-train-2026-09-23-21-35-22-1
|
streaming/evaluation-common-voice-23-0-es-slr72.json
CHANGED
|
@@ -16,7 +16,7 @@
|
|
| 16 |
},
|
| 17 |
"corpora": {
|
| 18 |
"common_voice_23_0_es_test": {
|
| 19 |
-
"
|
| 20 |
"source_manifest_sha256": "ca5e485fd427ca33802293a228b534e1ebb0a14e6f7187bf04f51dc56702d35c",
|
| 21 |
"preparation_revision": "591a99e9c5c9e308231746c7baa03eadfe670483",
|
| 22 |
"source_test_rows": 15893,
|
|
@@ -29,7 +29,7 @@
|
|
| 29 |
"overlap_note": "This official test split is reused by the recipe for validation."
|
| 30 |
},
|
| 31 |
"slr72_test": {
|
| 32 |
-
"
|
| 33 |
"source_manifest_sha256": "fda09e2a168617d6eebabe6553b93ee0b6cce654d26e050cb3482b41718c7d27",
|
| 34 |
"preparation_revision": "e7c9924b964eecbdcba1181add860367d3c7ca3a",
|
| 35 |
"source_test_rows": 981,
|
|
|
|
| 16 |
},
|
| 17 |
"corpora": {
|
| 18 |
"common_voice_23_0_es_test": {
|
| 19 |
+
"source_distribution": "https://mozilladatacollective.com/datasets/cmj8u3pe600fhnxxbqol7x8bg",
|
| 20 |
"source_manifest_sha256": "ca5e485fd427ca33802293a228b534e1ebb0a14e6f7187bf04f51dc56702d35c",
|
| 21 |
"preparation_revision": "591a99e9c5c9e308231746c7baa03eadfe670483",
|
| 22 |
"source_test_rows": 15893,
|
|
|
|
| 29 |
"overlap_note": "This official test split is reused by the recipe for validation."
|
| 30 |
},
|
| 31 |
"slr72_test": {
|
| 32 |
+
"source_distribution": "https://www.openslr.org/72/",
|
| 33 |
"source_manifest_sha256": "fda09e2a168617d6eebabe6553b93ee0b6cce654d26e050cb3482b41718c7d27",
|
| 34 |
"preparation_revision": "e7c9924b964eecbdcba1181add860367d3c7ca3a",
|
| 35 |
"source_test_rows": 981,
|