QA Retrieval on Indic QA Retrieval
52.5nDCG@10 (Hin)Synth - Adapter Composition
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Synth - Adapter CompositionBackbone=XLM-R2026.03 | 52.5 | 57.5 | 57.7 | 52.7 | 71.5 | 75.8 | 77.5 | 71.4 | |
| Synth - PromptingBackbone=XLM-R2026.03 | 52.3 | 52.3 | 51.8 | 48.5 | 72 | 71.7 | 72.1 | 67.6 | |
| Synth - XL-LoRABackbone=XLM-R2026.03 | 51.2 | 57.6 | 55.1 | 53.8 | 70.6 | 75.8 | 75.4 | 72.8 | |
| Cross LingualBackbone=XLM-R2026.03 | 50.7 | 55 | 50.8 | 48.7 | 70 | 73.4 | 69.6 | 67.2 | |
| Synth - XL-LoRABackbone=mmBERT2026.03 | 48.8 | 58.6 | 51.6 | 53.8 | 68.2 | 76.8 | 69.7 | 72.8 | |
| Synth - Adapter CompositionBackbone=mmBERT2026.03 | 48.5 | 52.7 | 47 | 52.7 | 66.2 | 72.3 | 65.1 | 71.4 | |
| Cross LingualBackbone=mmBERT2026.03 | 46.2 | 50.1 | 39.6 | 48.7 | 64.9 | 68.3 | 57.2 | 67.2 | |
| Synth - PromptingBackbone=mmBERT2026.03 | 44.4 | 47.8 | 42.5 | 48.5 | 62.9 | 67 | 59.9 | 67.6 | |
| UnsupervisedBackbone=XLM-R2026.03 | 43.2 | 44.6 | 48.2 | 31.7 | 61.9 | 62.8 | 67.2 | 47.7 | |
| UnsupervisedBackbone=mmBERT2026.03 | 17.1 | 23.1 | 13.9 | 31.7 | 31.5 | 38.7 | 24.2 | 47.7 | |
| Base EncoderBackbone=XLM-R2026.03 | 5.9 | 21 | 21.7 | 15.4 | 12.2 | 31.1 | 43.1 | 25.4 | |
| Base EncoderBackbone=mmBERT2026.03 | 1.9 | 2 | 39.6 | 15.4 | 4.3 | 4.6 | 57.2 | 25.4 |