model,task,prompt,eng,amh,hau,ibo,kin,lin,lug,orm,sna,sot,swa,xho,yor,zul,avg
Gemma 3 27b,injongointent,4,79.58,71.56,69.53,56.56,53.44,38.12,37.97,31.25,56.88,47.66,81.09,63.59,49.53,60.78,55.2
Gemma 3 27b,afrixnli,2,65.5,59.5,55.5,53.83,46.67,35.17,48.17,50.17,52.67,51.83,55.67,53.83,48.17,54.83,51.2
Gemma 3 27b,afrimmlu,1,74.2,52.6,45.2,47,44.6,36.8,34,34.2,45.2,44.8,60.2,44.8,40.2,47,44.4
Gemma 3 27b,afrimgsm,2,87.6,61.2,61.2,36.8,54,18.4,36.4,32,52,51.6,78,48.8,36.8,50.8,47.5
Gemma 3 27b,belebele,5,93.44,76.44,71.44,59.22,69,38.44,44.67,52.11,68.78,62,84.7,67.33,49.56,67,62.4
Gemma 3 27b,sib,3,87.25,83.33,80.4,81.86,82.84,59.8,67.16,58.33,76.47,72.55,72.06,77.45,71.08,80.88,74.2
Gemma 3 27b,flores - en_xx,,68.9,23.8,43.9,35.2,35.6,24.8,21.6,17.5,35.1,38.1,57,35.8,21,40.8,33.1
Gemini-2.0 Flash,injongointent,4,88.9,84.8,80.5,78.8,63.8,65.3,63.0,62.3,77.0,59.4,91.4,84.2,75.3,74.5,73.9
Gemini-2.0 Flash,sib,3,86.8,87.3,85.3,82.8,87.3,84.8,81.9,80.4,85.8,82.8,87.8,86.3,84.3,87.3,84.9
Gemini-2.0 Flash,afrixnli,3,87.0,74.2,72.0,68.7,62.5,32.2,67.5,70.0,71.5,68.7,74.0,71.8,63.2,68.3,66.5
Gemini-2.0 Flash,belebele,4,63.0,66.0,49.2,48.7,59.3,51.9,54.3,52.0,63.4,50.8,69.8,61.8,49.9,61.3,56.8
Gemini-2.0 Flash,afrimmlu,5,80.8,65.0,61.2,57.4,54.4,52.8,49.4,51.8,57.0,55.8,71.4,60.6,57.4,56.8,57.8
Gemini-2.0 Flash,afrimgsm,2,92.8,76.0,70.4,61.2,64.4,63.6,59.2,73.6,63.6,65.2,84.0,60.8,70.8,65.2,67.5
Gemini-2.0 Flash,flores - en_xx,2,71.5,66.0,60.9,57.8,59.2,51.7,52.2,54.7,54.8,63.6,70.3,62.4,50.5,64.2,59.1
Gemini-2.0 Flash,flores - xx_en,2,73.1,40.9,54.3,45.2,53.0,51.5,44.0,44.2,50.2,52.0,65.2,54.3,31.6,58.4,49.6
GPT-4.1 (April),injongointent,1,87.8,86.6,93.3,86.6,77.2,82.8,81.3,73.8,90.2,75.0,93.9,89.5,85.6,81.9,84.4
GPT-4.1 (April),sib,1,89.7,85.8,84.8,85.8,87.3,84.3,82.4,84.3,86.3,86.3,81.4,87.7,80.4,85.8,84.8
GPT-4.1 (April),afrixnli,1,88.5,70.8,72.7,69.0,69.3,32.0,67.0,68.0,73.7,71.5,72.8,74.0,67.2,69.8,67.5
GPT-4.1 (April),belebele,1,73.9,72.0,48.0,37.7,76.4,61.7,54.0,58.3,77.6,60.8,90,78,52.2,76.1,64.8
GPT-4.1 (April),afrimmlu,1,71.4,55.2,55.4,56.2,63.8,60.2,50.2,53,65.2,57,76.8,66.6,53.6,69.8,60.2
GPT-4.1 (April),afrimgsm,1,82.4,57.2,57.2,54,60.4,49.6,54.4,64.4,60,64.4,77.2,51.2,65.2,58,59.5
GPT-4.1 (April),flores - en_xx,1,73.1,32.5,53.1,42.0,53.2,48.7,41.3,41.6,49.6,50.6,65.5,53.6,27.5,55.7,47.3
LLaMa 4 405B,injongointent,4,88.9,84.8,80.5,78.8,63.8,65.3,63.0,62.3,77.0,59.4,91.4,84.2,75.3,74.5,73.9
LLaMa 4 405B,sib,3,84.8,86.8,80.9,82.4,74.5,84.3,79.4,71.6,77.5,77.9,86.8,84.8,78.9,81.9,80.6
LLaMa 4 405B,afrixnli,2,49.2,56.8,44.8,53.3,43.0,35.3,42.5,45.0,46.5,43.7,48.5,47.0,41.8,43.0,45.5
LLaMa 4 405B,belebele,5,25,24.78,24.11,24.44,24.67,25.22,24.78,24.22,24.67,25.22,24.56,24.78,23.89,24.33,24.6
LLaMa 4 405B,afrimmlu,1,11.2,18.4,16.2,18.0,14.2,10.8,14.8,16.0,15.2,16.0,15.6,16.4,16.8,17.0,15.8
LLaMa 4 405B,afrimgsm,4,97.6,83.2,68.8,64.4,60,52,46.8,58.8,67.2,65.2,89.2,61.2,64.8,64,65.0
LLaMa 4 405B,flores - en_xx,3,73,37.64,50.34,43.73,39.05,41.76,34.11,36.48,40.53,40.07,61.96,50.25,28,53.07,42.8
LLaMa 4 405B,flores - xx_en,3,71.55,62.57,56.47,53.5,54.28,43.12,44.89,46.96,50.36,56.32,67.83,58.03,44.82,60.64,53.8
Lugha-Llama 8B,injongointent,1,16.7,3.1,5.8,4.2,3.0,8.0,2.3,2.5,2.5,5.0,5.6,2.7,5.8,2.5,4.1
Lugha-Llama 8B,sib,1,43.6,43.6,32.4,30.9,41.7,24.5,34.8,42.2,29.4,30.4,42.6,27.0,43.1,21.1,34.1
Lugha-Llama 8B,afrixnli,1,46.8,37.0,37.3,37.2,35.5,33.3,34.2,36.2,35.8,35.8,39.7,37.2,38.7,38.7,36.7
Lugha-Llama 8B,belebele,1,22.4,23.1,22.9,22.9,23.2,22.9,23.7,22.1,23.2,22.7,23.4,22.8,22.9,23.1,23.0
Lugha-Llama 8B,afrimmlu,1,31.8,24.6,24.8,23.8,24.8,26.4,24.6,23.2,26.2,25.4,27.8,26.6,23.6,25.6,25.2
Lugha-Llama 8B,afrimgsm,1,6.4,2.4,0.8,2,1.2,0.8,2.4,1.6,0.8,2,2,2,2.4,3.6,1.8
Lugha-Llama 8B,flores - en_xx,1,51.3,7.9,19.3,25.5,29.2,9.6,15.3,5.7,30.3,25.9,40.9,31.3,16.9,29.4,22.1