Multilingual Long-context Retrieval on MLDR
74.4nDCG@10① MILCO (SAP, SCTKD, LexEcho)
Evaluation Results
| Method | Links | |
|---|---|---|
| ① MILCO (SAP, SCTKD, LexEcho)Size=560M, Max Length=5122025.10 | 74.4 | |
| PLAID-X (Multi-vector)Size=560M, Max Length=5122025.10 | 74.2 | |
| mGTE-TRM Dense + SparseSize=304M, Max Length=81922025.10 | 71.3 | |
| mGTE-TRM SparseSize=304M, Max Length=81922025.10 | 71 | |
| ② MILCO (SAP, SCTKD, MLMen)Size=560M, Max Length=5122025.10 | 69.9 | |
| M3-AllSize=560M, Max Length=81922025.10 | 65 | |
| M3-Dense+SparseSize=560M, Max Length=81922025.10 | 64.8 | |
| DRAMA_1B-MLDRParam.=1B, L-CPT=false, L-FT=true, Max Len=128k2025.02 | 62.3 | |
| M3-SparseSize=560M, Max Length=81922025.10 | 62.2 | |
| DRAMA_0.1B-MLDRParam.=113M, L-CPT=false, L-FT=true, Max Len=81922025.02 | 60.2 | |
| Qwen3-Embed-8BSize=8B, Max Length=327682025.10 | 59.1 | |
| DRAMA_0.3B-MLDRParam.=265M, L-CPT=false, L-FT=true, Max Len=81922025.02 | 58.9 | |
| M3-Multi-vectorSize=560M, Max Length=81922025.10 | 57.6 | |
| mGTE-TRM DenseSize=304M, Max Length=81922025.10 | 56.9 | |
| mGTE-DenseParam.=113M, L-CPT=true, L-FT=true, Max Len=81922025.02 | 56.6 | |
| DRAMA_1BParam.=1B, L-CPT=false, L-FT=false, Max Len=128k2025.02 | 54.8 | |
| BM25Param.=-, L-CPT=false, L-FT=false, Max Len=∞2025.02 | 53.6 | |
| BM25Size=2, Max Length=81922025.10 | 53.6 | |
| M3-BGE-DenseParam.=303M, L-CPT=true, L-FT=true, Max Len=81922025.02 | 52.5 | |
| M3-DenseSize=560M, Max Length=81922025.10 | 52.5 | |
| Qwen3-Embed-0.6BSize=0.6B, Max Length=327682025.10 | 50.1 | |
| DRAMA_0.3BParam.=265M, L-CPT=false, L-FT=false, Max Len=81922025.02 | 48.8 | |
| DRAMA_0.1BParam.=113M, L-CPT=false, L-FT=false, Max Len=81922025.02 | 47.1 | |
| M3-BGE-DenseParam.=303M, L-CPT=true, L-FT=false, Max Len=81922025.02 | 45 | |
| E5mistral-7bSize=7B, Max Length=81922025.10 | 42.6 | |
| mE5-largeParam.=303M, L-CPT=false, L-FT=false, Max Len=5122025.02 | 34.2 | |
| mE5largeSize=560M, Max Length=5122025.10 | 34.2 | |
| ArcticEmb-v2-MParam.=113M, L-CPT=false, L-FT=false, Max Len=81922025.02 | 34 |