Retrieval on MIRACL Hard Negative
22nDCG@10 (Hindi)Cross Lingual
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Cross LingualEncoder=mmBERT2026.03 | 22 | 8.2 | 20 | 28.3 | 19.4 | 30.6 | 13.6 | 27.7 | 37.5 | 27.7 | |
| Synth - XL-LoRAEncoder=mmBERT2026.03 | 20.8 | 11.6 | 22.5 | 26.9 | 20.2 | 29.3 | 19.4 | 29.8 | 36.2 | 29.2 | |
| Cross LingualEncoder=XLM-R2026.03 | 19.8 | 13.3 | 16.5 | 27.4 | 19.4 | 29.8 | 22 | 23.9 | 36.3 | 27.7 | |
| Synth - XL-LoRAEncoder=XLM-R2026.03 | 18.8 | 16.7 | 18.1 | 25.9 | 20.2 | 28.4 | 28 | 25.2 | 37.1 | 29.2 | |
| Synth - PromptingEncoder=XLM-R2026.03 | 16.7 | 16.3 | 15.1 | 21.6 | 15.6 | 24.5 | 28.8 | 21.6 | 32.5 | 24 | |
| Synth - Adapter CompositionEncoder=mmBERT2026.03 | 16.6 | 11.5 | 21.7 | 29.1 | 19.6 | 25.4 | 19.8 | 29.4 | 40.5 | 29.2 | |
| Synth - Adapter CompositionEncoder=XLM-R2026.03 | 16.5 | 17 | 18.8 | 25.5 | 19.6 | 26.5 | 28.4 | 26.4 | 37.4 | 29.2 | |
| UnsupervisedEncoder=XLM-R2026.03 | 16.1 | 11 | 8.6 | 22.7 | 9 | 23.5 | 17.6 | 12.1 | 29.1 | 13.1 | |
| Synth - PromptingEncoder=mmBERT2026.03 | 9.5 | 11.4 | 9.7 | 24.5 | 15.6 | 13.6 | 20.2 | 14.5 | 36.6 | 24 | |
| UnsupervisedEncoder=mmBERT2026.03 | 2.2 | 0.7 | 3.3 | 7.7 | 9 | 3.8 | 1 | 5.2 | 12.1 | 13.1 | |
| Base EncoderEncoder=XLM-R2026.03 | 1.4 | 0.6 | 0.3 | 4.9 | 1 | 1.7 | 0.7 | 0.6 | 6.6 | 1.4 | |
| Base EncoderEncoder=mmBERT2026.03 | 0.3 | 0 | 0 | 0.7 | 1 | 0.4 | 0 | 0.1 | 0.7 | 1.4 |