Passage Ranking on TREC DL 2020
0.729NDCG@10LLaMA2-Llama2Vec
Evaluation results
| Method | Links | |
|---|---|---|
| LLaMA2-Llama2VecSize=7B, FT.=hard2023.12 | 0.729 | |
| uniCOIL-ColBERTV2-CQSpace=10.2GB (1x), Mechanism=re-ranking, Retriever=uniCOIL, M=16, K=2562022.03 | 0.726 | |
| LLaMA2-RepLLaMASize=7B, FT.=hard2023.12 | 0.721 | |
| DebiasFirstOrder=Original, First-stage retriever=Contriever2026.04 | 0.72 | |
| DebiasFirstOrder=Shuffle, First-stage retriever=Contriever2026.04 | 0.714 | |
| RankZephyrOrder=Original, First-stage retriever=Contriever2026.04 | 0.712 | |
| DupMAE (stage 2)Fine-tuning strategy=hard2022.11 | 0.7095 | |
| DupMAE (stage 3)Fine-tuning strategy=distill2022.11 | 0.7083 | |
| RankZephyrOrder=Shuffle, First-stage retriever=Contriever2026.04 | 0.707 | |
| RetroMAEFine-tuning strategy=distill2022.11 | 0.706 | |
| FirstOrder=Original, First-stage retriever=Contriever2026.04 | 0.702 | |
| SimLMFine-tuning strategy=distill2022.11 | 0.697 | |
| SimLM+distillSize=110M, FT.=distill2023.12 | 0.697 | |
| TAS-BFine-tuning strategy=distill2022.11 | 0.693 | |
| TAS-BSize=55M, FT.=distill2023.12 | 0.692 | |
| SimLMSize=110M, FT.=hard2023.12 | 0.692 | |
| First modelOrder=Shuffle, First-stage retriever=Contriever2026.04 | 0.69 | |
| coCondenserFine-tuning strategy=hard2022.11 | 0.684 | |
| coCondenserSize=110M, FT.=hard2023.12 | 0.684 | |
| ListT5(r=2)Order=Shuffle, First-stage retriever=Contriever2026.04 | 0.679 | |
| OpenAI-Ada-0022023.12 | 0.676 | |
| ListT5(r=2)Order=Original, First-stage retriever=Contriever2026.04 | 0.673 | |
| ANCEFine-tuning strategy=hard2022.11 | 0.615 | |
| BM252023.12 | 0.48 |