Model description: eus-cat
Date: 2024-08-09
TF version 2.10.0, OpenNMT version 2.29.1, CTranslate2 version 3.22.0
Test data set
  BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 38.8 (μ = 38.8 ± 0.3) 67.0/44.7/32.4/23.9 (BP = 0.995 ratio = 0.995 hyp_len = 396764 ref_len = 398892)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 63.6 (μ = 63.7 ± 0.2)
Flores data set
  BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 24.9 (μ = 24.8 ± 0.9) 57.4/31.3/19.1/12.1 (BP = 0.979 ratio = 0.980 hyp_len = 26746 ref_len = 27304)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 53.1 (μ = 53.1 ± 0.7)