List your company
ResearchFormerly WizWand

Passage Ranking on TREC DL 2019

0.751NDCG@10RetroMAEv2+distll
0.49620.562350.62850.69465Mar 29, 2022Nov 28, 2022Jul 31, 2023Mar 31, 2024Dec 1, 2024Aug 2, 2025Apr 4, 2026
Updated 7mo ago

Evaluation results

MethodLinks
RetroMAEv2+distllSize=110M, FT.=distill2023.120.751
DupMAE (stage 3)Fine-tuning strategy=distill2022.110.7509
uniCOIL-ColBERTV2-CQSpace=10.2GB (1x), Mechanism=re-ranking, Retriever=uniCOIL, M=16, K=2562022.030.746
LLaMA2-RepLLaMASize=7B, FT.=hard2023.120.743
LLaMA2-Llama2VecSize=7B, FT.=hard2023.120.734
SPLADEv2Fine-tuning strategy=distill2022.110.729
TAS-BSize=55M, FT.=distill2023.120.722
coCondenserFine-tuning strategy=hard2022.110.717
coCondenserSize=110M, FT.=hard2023.120.717
SimLMFine-tuning strategy=distill2022.110.714
SimLM+distillSize=110M, FT.=distill2023.120.714
DupMAE (stage 2)Fine-tuning strategy=hard2022.110.7128
TAS-BFine-tuning strategy=distill2022.110.712
DebiasFirstOrder=Shuffle, First-stage retriever=Contriever2026.040.711
OpenAI-Ada-0022023.120.704
DebiasFirstOrder=Original, First-stage retriever=Contriever2026.040.7
ListT5(r=2)Order=Original, First-stage retriever=Contriever2026.040.699
CondenserFine-tuning strategy=hard2022.110.698
CondenserSize=110M, FT.=hard2023.120.698
SimLMSize=110M, FT.=hard2023.120.698
RankZephyrOrder=Shuffle, First-stage retriever=Contriever2026.040.696
RankZephyrOrder=Original, First-stage retriever=Contriever2026.040.693
ListT5(r=2)Order=Shuffle, First-stage retriever=Contriever2026.040.69
ADOREFine-tuning strategy=hard2022.110.683
ADORESize=110M, FT.=hard2023.120.683
FirstOrder=Original, First-stage retriever=Contriever2026.040.682
RetroMAEFine-tuning strategy=distill2022.110.681
RetroMAE+distillSize=110M, FT.=distill2023.120.681
First modelOrder=Shuffle, First-stage retriever=Contriever2026.040.673
ANCEFine-tuning strategy=hard2022.110.648
ANCESize=125M, FT.=hard2023.120.648
BM252023.120.506