douyeszn/w2vbert-lin-waxal-aug-ft

w2vbert-lin-waxal-aug

Compliant Lingala W2V-BERT 2.0 CTC model for the Google WAXAL ASR Challenge. Fine-tuned from facebook/w2v-bert-2.0 on WAXAL train split only, with case + punctuation kept in the vocab, a speaker-disjoint validation split, and noise + speed augmentation for out-of-domain (Phase-2) robustness.

Best validation (speaker-disjoint, honest)

Validation speakers are disjoint from training speakers, so this predicts fresh-audio (Phase-2) performance rather than the inflated numbers a leaking split gives.

• Combined (0.5·WER + 0.5·CER): 0.2450
• WER: 0.3435 | CER: 0.1465
• step 800 (epoch 0.97)

Training results

epoch	step	val loss	WER	CER	combined
0.48	400	0.7202	0.3514	0.1492	0.2503
0.97	800	0.7451	0.3435	0.1465	0.2450
1.45	1200	0.7077	0.3481	0.1489	0.2485
1.94	1600	0.7030	0.3473	0.1485	0.2479
2.42	2000	0.8118	0.3456	0.1475	0.2466
2.91	2400	0.7814	0.3470	0.1488	0.2479
3.39	2800	0.8066	0.3550	0.1551	0.2551
3.88	3200	0.8372	0.3509	0.1530	0.2519
4.36	3600	0.8636	0.3528	0.1563	0.2545
4.85	4000	0.8791	0.3556	0.1565	0.2561
5.33	4400	0.9203	0.3497	0.1515	0.2506
5.82	4800	0.9752	0.3466	0.1496	0.2481
6.30	5200	1.0082	0.3519	0.1517	0.2518
6.79	5600	0.9574	0.3539	0.1547	0.2543
7.27	6000	0.9518	0.3525	0.1510	0.2518
7.76	6400	0.9977	0.3505	0.1500	0.2502
8.24	6800	1.0544	0.3514	0.1500	0.2507
8.73	7200	1.0441	0.3521	0.1508	0.2515
9.21	7600	1.0625	0.3519	0.1503	0.2511
9.70	8000	1.0699	0.3518	0.1506	0.2512

Data & compliance

• Training data: WAXAL Lingala train split only. The Phase-1 test split is never read (no test audio or transcriptions used at any point).
• Validation: a speaker-disjoint slice carved from the labelled data (no speaker appears in both train and validation).
• Base model: facebook/w2v-bert-2.0 (openly available).
• Augmentation: Gaussian noise at randomised SNR + speed perturbation.
• Labels: case and punctuation preserved (minimal NFC + whitespace cleanup only).