Retrieval on Belebele
92.7Afr ScoreSynth - XL-LoRA
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Synth - XL-LoRABackbone=mmBERT2026.03 | 92.7 | — | 86.3 | 87.8 | 81.2 | 94 | 74.2 | 93.3 | 86.9 | |
| Synth - XL-LoRABackbone=XLM-R2026.03 | 91.1 | — | 84.8 | 87 | 80.2 | 91.9 | 80.1 | 91.6 | 86.9 | |
| Cross LingualBackbone=mmBERT2026.03 | 90.6 | — | 78.7 | 78.1 | 62.8 | 92.7 | 37.3 | 90.7 | 77.9 | |
| Synth - Adapter CompositionBackbone=mmBERT2026.03 | 90.4 | — | 75.6 | 76.6 | 72.4 | 90.7 | 58.8 | 85.1 | 80.3 | |
| Synth - Adapter CompositionBackbone=XLM-R2026.03 | 89.1 | — | 78.2 | 83.8 | 75.7 | 89.3 | 72.4 | 85.9 | 80.3 | |
| Cross LingualBackbone=XLM-R2026.03 | 87.4 | — | 80 | 83.1 | 77.1 | 90.3 | 54.2 | 86.9 | 77.9 | |
| Synth - PromptingBackbone=XLM-R2026.03 | 84.1 | — | 73.4 | 77.3 | 71.7 | 84.6 | 63.8 | 85.9 | 74.2 | |
| Synth - PromptingBackbone=mmBERT2026.03 | 81.1 | — | 69.6 | 70.8 | 64.9 | 86.6 | 40.9 | 84.4 | 74.2 | |
| UnsupervisedBackbone=mmBERT2026.03 | 52.2 | — | 32 | 27 | 22 | 69.2 | 8.9 | 47 | 39.3 | |
| Base EncoderBackbone=XLM-R2026.03 | 20.8 | — | 16.8 | 20.4 | 20.9 | 39.8 | 10.6 | 31.9 | 12.6 | |
| UnsupervisedBackbone=XLM-R2026.03 | 12.8 | — | 13.7 | 11.2 | 64.1 | 81.2 | 30 | 78.3 | 39.3 | |
| Base EncoderBackbone=mmBERT2026.03 | 2.2 | — | 1.7 | 2 | 2.1 | 2.1 | 2.4 | 2.4 | 12.6 |