List your company
ResearchFormerly WizWand

Multilingual Long-context Retrieval on MLDR

74.4nDCG@10① MILCO (SAP, SCTKD, LexEcho)
32.38443.29254.265.108Feb 25, 2025Apr 2, 2025May 8, 2025Jun 14, 2025Jul 20, 2025Aug 25, 2025Oct 1, 2025
Updated 7mo ago

Evaluation results

MethodLinks
① MILCO (SAP, SCTKD, LexEcho)Size=560M, Max Length=5122025.1074.4
PLAID-X (Multi-vector)Size=560M, Max Length=5122025.1074.2
mGTE-TRM Dense + SparseSize=304M, Max Length=81922025.1071.3
mGTE-TRM SparseSize=304M, Max Length=81922025.1071
② MILCO (SAP, SCTKD, MLMen)Size=560M, Max Length=5122025.1069.9
M3-AllSize=560M, Max Length=81922025.1065
M3-Dense+SparseSize=560M, Max Length=81922025.1064.8
DRAMA_1B-MLDRParam.=1B, L-CPT=false, L-FT=true, Max Len=128k2025.0262.3
M3-SparseSize=560M, Max Length=81922025.1062.2
DRAMA_0.1B-MLDRParam.=113M, L-CPT=false, L-FT=true, Max Len=81922025.0260.2
Qwen3-Embed-8BSize=8B, Max Length=327682025.1059.1
DRAMA_0.3B-MLDRParam.=265M, L-CPT=false, L-FT=true, Max Len=81922025.0258.9
M3-Multi-vectorSize=560M, Max Length=81922025.1057.6
mGTE-TRM DenseSize=304M, Max Length=81922025.1056.9
mGTE-DenseParam.=113M, L-CPT=true, L-FT=true, Max Len=81922025.0256.6
DRAMA_1BParam.=1B, L-CPT=false, L-FT=false, Max Len=128k2025.0254.8
BM25Param.=-, L-CPT=false, L-FT=false, Max Len=∞2025.0253.6
BM25Size=2, Max Length=81922025.1053.6
M3-BGE-DenseParam.=303M, L-CPT=true, L-FT=true, Max Len=81922025.0252.5
M3-DenseSize=560M, Max Length=81922025.1052.5
Qwen3-Embed-0.6BSize=0.6B, Max Length=327682025.1050.1
DRAMA_0.3BParam.=265M, L-CPT=false, L-FT=false, Max Len=81922025.0248.8
DRAMA_0.1BParam.=113M, L-CPT=false, L-FT=false, Max Len=81922025.0247.1
M3-BGE-DenseParam.=303M, L-CPT=true, L-FT=false, Max Len=81922025.0245
E5mistral-7bSize=7B, Max Length=81922025.1042.6
mE5-largeParam.=303M, L-CPT=false, L-FT=false, Max Len=5122025.0234.2
mE5largeSize=560M, Max Length=5122025.1034.2
ArcticEmb-v2-MParam.=113M, L-CPT=false, L-FT=false, Max Len=81922025.0234