Multilingual Long Document Retrieval on MLDR 13 (test)
57.5NDCG@10Inf-DDS
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Inf-DDSDev Dataset=MLDR-132026.01 | 57.5 | 58.3 | 54.4 | 48.5 | 80.6 | 77.9 | 43.9 | 66.1 | 56.7 | 49.9 | 79.5 | 65.7 | 39 | 26.6 | |
| DoReMiDev Dataset=N/A2026.01 | 57.2 | 54.8 | 54.4 | 50.7 | 79.1 | 77.1 | 44.5 | 66.6 | 54.1 | 48 | 82.3 | 64.5 | 39.9 | 27.8 | |
| CRISPDev Dataset=MLDR-13, n=32/lang2026.01 | 57.1 | 56.7 | 53.3 | 52.6 | 79.5 | 75.6 | 44 | 66.6 | 55.4 | 48.8 | 79.3 | 64.7 | 36.7 | 28.9 | |
| MultiDDSDev Dataset=MLDR-132026.01 | 56.7 | 56 | 53.9 | 50 | 79.1 | 76.3 | 44.1 | 66 | 56.6 | 49.3 | 78.6 | 62.3 | 37.3 | 27.3 | |
| CRISPDev Dataset=MLDR-13, n=32^2/lang2026.01 | 56.6 | 53.1 | 53.9 | 52 | 79.8 | 75.5 | 44.9 | 65.5 | 54.5 | 48.6 | 78 | 62.8 | 38.5 | 28.5 | |
| CooldownDev Dataset=N/A2026.01 | 52.7 | 51.5 | 50.2 | 48.5 | 75.6 | 72.6 | 33.1 | 61.7 | 48.4 | 41.3 | 75.5 | 61.4 | 37.8 | 27.7 | |
| bge-m3-denseDev Dataset=N/A2026.01 | 52.5 | 47.6 | 46.1 | 48.9 | 74.8 | 73.8 | 40.7 | 62.7 | 50.9 | 42.9 | 74.4 | 59.5 | 33.6 | 26 | |
| bge-m3-denseDev Dataset=N/A, Reproduced=true2026.01 | 52.5 | 48.4 | 46.7 | 46.7 | 76.3 | 74.3 | 40 | 61.7 | 49.1 | 41 | 74.3 | 60.8 | 36 | 26.7 | |
| DoGEDev Dataset=MLDR-13, iteration=22026.01 | 49.6 | 44.9 | 47 | 47.1 | 72.7 | 70.5 | 34.6 | 58.5 | 44.4 | 37 | 73.3 | 56.7 | 33.2 | 25 | |
| LMKFT. Gran.=Variable, EVAL. Gran.=322026.01 | 38.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LMKFT. Gran.=Variable, EVAL. Gran.=642026.01 | 38.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LMKFT. Gran.=Variable, EVAL. Gran.=1282026.01 | 38.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LMKFT. Gran.=Variable, EVAL. Gran.=2562026.01 | 38 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LMKFT. Gran.=128, EVAL. Gran.=1282026.01 | 37.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| bge-m3 unsup.Dev Dataset=N/A2026.01 | 37 | 30.8 | 38.4 | 34.2 | 61.4 | 53.1 | 23.9 | 43.7 | 33.3 | 24.9 | 59.7 | 45.8 | 18.6 | 13.7 | |
| CLS2026.01 | 24.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Latent2026.01 | 19.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Mean2026.01 | 17 | — | — | — | — | — | — | — | — | — | — | — | — | — |