Automatic Speech Recognition
Transformers
Safetensors
Finnish
wav2vec2
smi
sami
Eval Results (legacy)
Instructions to use GetmanY1/wav2vec2-base-sami-22k-finetuned with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use GetmanY1/wav2vec2-base-sami-22k-finetuned with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="GetmanY1/wav2vec2-base-sami-22k-finetuned")# Load model directly from transformers import AutoProcessor, AutoModelForCTC processor = AutoProcessor.from_pretrained("GetmanY1/wav2vec2-base-sami-22k-finetuned") model = AutoModelForCTC.from_pretrained("GetmanY1/wav2vec2-base-sami-22k-finetuned", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -38,7 +38,7 @@ When using the model make sure that your speech input is also sampled at 16Khz.
|
|
| 38 |
The Sámi Wav2Vec2 Base has the same architecture and uses the same training objective as the English one described in [Paper](https://arxiv.org/abs/2006.11477).
|
| 39 |
|
| 40 |
[GetmanY1/wav2vec2-base-sami-22k](https://huggingface.co/GetmanY1/wav2vec2-base-sami-22k) is a large-scale, 95-million parameter monolingual model pre-trained on 22.4k hours of unlabeled Sámi speech from [KAVI radio and television archive materials](https://kavi.fi/en/radio-ja-televisioarkistointia-vuodesta-2008/).
|
| 41 |
-
You can read more about the pre-trained model from [this paper](
|
| 42 |
|
| 43 |
The model was evaluated on 1 hour of out-of-domain read-aloud and spontaneous speech of varying audio quality.
|
| 44 |
|
|
@@ -72,7 +72,7 @@ transcription = processor.batch_decode(predicted_ids)
|
|
| 72 |
|
| 73 |
### Prefix Beam Search
|
| 74 |
|
| 75 |
-
In our experiments (see [paper](
|
| 76 |
Note that an external language model (LM) **is not required**, as the function defaults to a uniform probability when none is provided.
|
| 77 |
|
| 78 |
```
|
|
@@ -175,6 +175,31 @@ def map_to_pred_prefix_beam_search(batch):
|
|
| 175 |
result = ds.map(map_to_pred_prefix_beam_search, batched=True, batch_size=1, remove_columns=["speech"])
|
| 176 |
```
|
| 177 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 178 |
## Team Members
|
| 179 |
|
| 180 |
- Yaroslav Getman, [Hugging Face profile](https://huggingface.co/GetmanY1), [LinkedIn profile](https://www.linkedin.com/in/yaroslav-getman/)
|
|
|
|
| 38 |
The Sámi Wav2Vec2 Base has the same architecture and uses the same training objective as the English one described in [Paper](https://arxiv.org/abs/2006.11477).
|
| 39 |
|
| 40 |
[GetmanY1/wav2vec2-base-sami-22k](https://huggingface.co/GetmanY1/wav2vec2-base-sami-22k) is a large-scale, 95-million parameter monolingual model pre-trained on 22.4k hours of unlabeled Sámi speech from [KAVI radio and television archive materials](https://kavi.fi/en/radio-ja-televisioarkistointia-vuodesta-2008/).
|
| 41 |
+
You can read more about the pre-trained model from [this paper](https://aclanthology.org/2025.nodalida-1.19/).
|
| 42 |
|
| 43 |
The model was evaluated on 1 hour of out-of-domain read-aloud and spontaneous speech of varying audio quality.
|
| 44 |
|
|
|
|
| 72 |
|
| 73 |
### Prefix Beam Search
|
| 74 |
|
| 75 |
+
In our experiments (see [paper](https://aclanthology.org/2025.nodalida-1.19/)), we observed a slight improvement in terms of Character Error Rate (CER) when using prefix beam search compared to greedy decoding, primarily due to a reduction in deletions. Below is our adapted version of [corticph/prefix-beam-search](https://github.com/corticph/prefix-beam-search) for use with wav2vec 2.0 in HuggingFace Transformers.
|
| 76 |
Note that an external language model (LM) **is not required**, as the function defaults to a uniform probability when none is provided.
|
| 77 |
|
| 78 |
```
|
|
|
|
| 175 |
result = ds.map(map_to_pred_prefix_beam_search, batched=True, batch_size=1, remove_columns=["speech"])
|
| 176 |
```
|
| 177 |
|
| 178 |
+
## Citation
|
| 179 |
+
|
| 180 |
+
If you use our models or scripts, please cite our article as:
|
| 181 |
+
|
| 182 |
+
```bibtex
|
| 183 |
+
@inproceedings{getman-etal-2025-towards,
|
| 184 |
+
title = "Towards large-scale speech foundation models for a low-resource minority language",
|
| 185 |
+
author = "Getman, Yaroslav and
|
| 186 |
+
Gr{\'o}sz, Tam{\'a}s and
|
| 187 |
+
Hiovain-Asikainen, Katri and
|
| 188 |
+
Lehtonen, Tommi and
|
| 189 |
+
Kurimo, Mikko",
|
| 190 |
+
editor = "Johansson, Richard and
|
| 191 |
+
Stymne, Sara",
|
| 192 |
+
booktitle = "Proceedings of the Joint 25th Nordic Conference on Computational Linguistics and 11th Baltic Conference on Human Language Technologies (NoDaLiDa/Baltic-HLT 2025)",
|
| 193 |
+
month = mar,
|
| 194 |
+
year = "2025",
|
| 195 |
+
address = "Tallinn, Estonia",
|
| 196 |
+
publisher = "University of Tartu Library",
|
| 197 |
+
url = "https://aclanthology.org/2025.nodalida-1.19/",
|
| 198 |
+
pages = "192--200",
|
| 199 |
+
ISBN = "978-9908-53-109-0"
|
| 200 |
+
}
|
| 201 |
+
```
|
| 202 |
+
|
| 203 |
## Team Members
|
| 204 |
|
| 205 |
- Yaroslav Getman, [Hugging Face profile](https://huggingface.co/GetmanY1), [LinkedIn profile](https://www.linkedin.com/in/yaroslav-getman/)
|