Automatic Speech Recognition
Transformers
Safetensors
Bhojpuri
Hindi
whisper
bhojpuri
indic
low-resource
Eval Results (legacy)
Instructions to use Aditya109/whisper-small-bhojpuri-merged with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Aditya109/whisper-small-bhojpuri-merged with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="Aditya109/whisper-small-bhojpuri-merged")# Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("Aditya109/whisper-small-bhojpuri-merged") model = AutoModelForSpeechSeq2Seq.from_pretrained("Aditya109/whisper-small-bhojpuri-merged", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Replace cited large-v3 baseline with measured 65.93 WER / 37.68 CER
Browse files
README.md
CHANGED
|
@@ -49,18 +49,16 @@ Read that one if you want to know how these numbers were produced.
|
|
| 49 |
|
| 50 |
## Results
|
| 51 |
|
| 52 |
-
Official Vaani Bhojpuri test split, n = 1,426.
|
| 53 |
-
utterances with the same normalizer
|
| 54 |
|
| 55 |
| Model | Params | WER ↓ | CER ↓ |
|
| 56 |
|---|---|---|---|
|
| 57 |
| `openai/whisper-small` (untrained) | 244M | 122.07 | 78.75 |
|
| 58 |
-
| `openai/whisper-large-v3` (untrained)
|
| 59 |
| `ARTPARK-IISc/SraVaani` | 430M | **34.80** | 20.29 |
|
| 60 |
| **This model** | 244M | 36.41 | **17.05** |
|
| 61 |
|
| 62 |
-
† Cited from the project spec, not measured here.
|
| 63 |
-
|
| 64 |
Against SraVaani — the model trained by the dataset's own authors — this is a
|
| 65 |
split decision, and both halves are statistically significant under a paired
|
| 66 |
bootstrap: SraVaani is better on WER by 1.61 (95% CI [+0.83, +2.44]), this
|
|
|
|
| 49 |
|
| 50 |
## Results
|
| 51 |
|
| 52 |
+
Official Vaani Bhojpuri test split, n = 1,426. Every row measured on the same
|
| 53 |
+
utterances, with the same normalizer and the same metric implementation.
|
| 54 |
|
| 55 |
| Model | Params | WER ↓ | CER ↓ |
|
| 56 |
|---|---|---|---|
|
| 57 |
| `openai/whisper-small` (untrained) | 244M | 122.07 | 78.75 |
|
| 58 |
+
| `openai/whisper-large-v3` (untrained) | 1.55B | 65.93 | 37.68 |
|
| 59 |
| `ARTPARK-IISc/SraVaani` | 430M | **34.80** | 20.29 |
|
| 60 |
| **This model** | 244M | 36.41 | **17.05** |
|
| 61 |
|
|
|
|
|
|
|
| 62 |
Against SraVaani — the model trained by the dataset's own authors — this is a
|
| 63 |
split decision, and both halves are statistically significant under a paired
|
| 64 |
bootstrap: SraVaani is better on WER by 1.61 (95% CI [+0.83, +2.44]), this
|