GetmanY1 commited on
Commit
f8a0ab9
·
verified ·
1 Parent(s): 353501e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -2
README.md CHANGED
@@ -38,7 +38,7 @@ When using the model make sure that your speech input is also sampled at 16Khz.
38
  The Sámi Wav2Vec2 Large has the same architecture and uses the same training objective as the English and multilingual one described in [Paper](https://arxiv.org/abs/2006.11477).
39
 
40
  [GetmanY1/wav2vec2-large-sami-22k](https://huggingface.co/GetmanY1/wav2vec2-large-sami-22k) is a large-scale, 317-million parameter monolingual model pre-trained on 22.4k hours of unlabeled Sámi speech from [KAVI radio and television archive materials](https://kavi.fi/en/radio-ja-televisioarkistointia-vuodesta-2008/).
41
- You can read more about the pre-trained model from [this paper](TODO).
42
 
43
  The model was evaluated on 1 hour of out-of-domain read-aloud and spontaneous speech of varying audio quality.
44
 
@@ -72,7 +72,7 @@ transcription = processor.batch_decode(predicted_ids)
72
 
73
  ### Prefix Beam Search
74
 
75
- In our experiments (see [paper](TODO)), we observed a slight improvement in terms of Character Error Rate (CER) when using prefix beam search compared to greedy decoding, primarily due to a reduction in deletions. Below is our adapted version of [corticph/prefix-beam-search](https://github.com/corticph/prefix-beam-search) for use with wav2vec 2.0 in HuggingFace Transformers.
76
  Note that an external language model (LM) **is not required**, as the function defaults to a uniform probability when none is provided.
77
 
78
  ```
@@ -175,6 +175,31 @@ def map_to_pred_prefix_beam_search(batch):
175
  result = ds.map(map_to_pred_prefix_beam_search, batched=True, batch_size=1, remove_columns=["speech"])
176
  ```
177
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
178
  ## Team Members
179
 
180
  - Yaroslav Getman, [Hugging Face profile](https://huggingface.co/GetmanY1), [LinkedIn profile](https://www.linkedin.com/in/yaroslav-getman/)
 
38
  The Sámi Wav2Vec2 Large has the same architecture and uses the same training objective as the English and multilingual one described in [Paper](https://arxiv.org/abs/2006.11477).
39
 
40
  [GetmanY1/wav2vec2-large-sami-22k](https://huggingface.co/GetmanY1/wav2vec2-large-sami-22k) is a large-scale, 317-million parameter monolingual model pre-trained on 22.4k hours of unlabeled Sámi speech from [KAVI radio and television archive materials](https://kavi.fi/en/radio-ja-televisioarkistointia-vuodesta-2008/).
41
+ You can read more about the pre-trained model from [this paper](https://aclanthology.org/2025.nodalida-1.19/).
42
 
43
  The model was evaluated on 1 hour of out-of-domain read-aloud and spontaneous speech of varying audio quality.
44
 
 
72
 
73
  ### Prefix Beam Search
74
 
75
+ In our experiments (see [paper](https://aclanthology.org/2025.nodalida-1.19/)), we observed a slight improvement in terms of Character Error Rate (CER) when using prefix beam search compared to greedy decoding, primarily due to a reduction in deletions. Below is our adapted version of [corticph/prefix-beam-search](https://github.com/corticph/prefix-beam-search) for use with wav2vec 2.0 in HuggingFace Transformers.
76
  Note that an external language model (LM) **is not required**, as the function defaults to a uniform probability when none is provided.
77
 
78
  ```
 
175
  result = ds.map(map_to_pred_prefix_beam_search, batched=True, batch_size=1, remove_columns=["speech"])
176
  ```
177
 
178
+ ## Citation
179
+
180
+ If you use our models or scripts, please cite our article as:
181
+
182
+ ```bibtex
183
+ @inproceedings{getman-etal-2025-towards,
184
+ title = "Towards large-scale speech foundation models for a low-resource minority language",
185
+ author = "Getman, Yaroslav and
186
+ Gr{\'o}sz, Tam{\'a}s and
187
+ Hiovain-Asikainen, Katri and
188
+ Lehtonen, Tommi and
189
+ Kurimo, Mikko",
190
+ editor = "Johansson, Richard and
191
+ Stymne, Sara",
192
+ booktitle = "Proceedings of the Joint 25th Nordic Conference on Computational Linguistics and 11th Baltic Conference on Human Language Technologies (NoDaLiDa/Baltic-HLT 2025)",
193
+ month = mar,
194
+ year = "2025",
195
+ address = "Tallinn, Estonia",
196
+ publisher = "University of Tartu Library",
197
+ url = "https://aclanthology.org/2025.nodalida-1.19/",
198
+ pages = "192--200",
199
+ ISBN = "978-9908-53-109-0"
200
+ }
201
+ ```
202
+
203
  ## Team Members
204
 
205
  - Yaroslav Getman, [Hugging Face profile](https://huggingface.co/GetmanY1), [LinkedIn profile](https://www.linkedin.com/in/yaroslav-getman/)