Retrieval on Belebele (nDCG@10)
81.9nDCG@10 (Afr)Synth - XL-LoRA
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Synth - XL-LoRABackbone=mmBERT2026.03 | 81.9 | — | 70.8 | 73.9 | 65.5 | 83.7 | 58.9 | 81 | 73.2 | |
| Synth - XL-LoRABackbone=XLM-R2026.03 | 79.2 | — | 70.1 | 71.6 | 64.6 | 79.1 | 65.8 | 78.4 | 73.2 | |
| Cross LingualBackbone=mmBERT2026.03 | 78.5 | — | 64.7 | 63 | 48 | 82.9 | 30 | 77.4 | 64.8 | |
| Synth - Adapter CompositionBackbone=XLM-R2026.03 | 77.7 | — | 64 | 68.6 | 61.3 | 76.9 | 56.7 | 73.1 | 66.3 | |
| Synth - Adapter CompositionBackbone=mmBERT2026.03 | 76.6 | — | 58.8 | 61 | 57.6 | 79.9 | 43.6 | 72.7 | 66.3 | |
| Cross LingualBackbone=XLM-R2026.03 | 74.9 | — | 65.6 | 66.8 | 60.2 | 79.1 | 41.9 | 74.3 | 64.8 | |
| Synth - PromptingBackbone=XLM-R2026.03 | 70.5 | — | 58.5 | 61 | 56.6 | 71 | 48.3 | 72.7 | 59.4 | |
| Synth - PromptingBackbone=mmBERT2026.03 | 65 | — | 53.6 | 53.5 | 48.7 | 73.2 | 28 | 70.9 | 59.4 | |
| UnsupervisedBackbone=mmBERT2026.03 | 36.1 | — | 20.1 | 16.8 | 12.5 | 54.4 | 5 | 32.1 | 28.2 | |
| Base EncoderBackbone=XLM-R2026.03 | 14.7 | — | 11.5 | 13.8 | 14.8 | 27.9 | 5.9 | 23 | 8.5 | |
| UnsupervisedBackbone=XLM-R2026.03 | 7.4 | — | 8 | 5.7 | 49.7 | 66.5 | 18.6 | 62.4 | 28.2 | |
| Base EncoderBackbone=mmBERT2026.03 | 1.1 | — | 0.8 | 0.9 | 1 | 1.1 | 1.2 | 1.2 | 8.5 |