| Model description: eus-cat |
| Date: 2024-08-09 |
| TF version 2.10.0, OpenNMT version 2.29.1, CTranslate2 version 3.22.0 |
| Test data set |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 38.8 (μ = 38.8 ± 0.3) 67.0/44.7/32.4/23.9 (BP = 0.995 ratio = 0.995 hyp_len = 396764 ref_len = 398892) |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 63.6 (μ = 63.7 ± 0.2) |
| Flores data set |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 24.9 (μ = 24.8 ± 0.9) 57.4/31.3/19.1/12.1 (BP = 0.979 ratio = 0.980 hyp_len = 26746 ref_len = 27304) |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 53.1 (μ = 53.1 ± 0.7) |
|
|
