Reranking on TREC 2020 (test)
70.9NDCG@10RankZephyr-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| RankZephyr-7BTraining=LLM-distil., Scale (%)=1002026.01 | 70.9 | |
| RocketQAv2-reranker + HybRankreranking_extension=HybRank2023.05 | 70.71 | |
| RocketQAv2-rerankerreranking=HybRank2023.05 | 70.71 | |
| RankGPTTraining=GPT-42026.01 | 70.6 | |
| Rank-Nexus-2BTraining=LLM-distil., Scale (%)=7.52026.01 | 70 | |
| RocketQA-reranker + HybRankreranking_extension=HybRank2023.05 | 69.85 | |
| RocketQA-rerankerreranking=HybRank2023.05 | 69.85 | |
| RocketQAv2-rerankerreranking_extension=none2023.05 | 69.47 | |
| RocketQAv2-rerankerreranking=None2023.05 | 69.47 | |
| Setwise-Rank-R1-7BTraining=SFT, Scale (%)=182026.01 | 69.2 | |
| Rank-R1-14BTraining=RL, Scale (%)=182026.01 | 69.1 | |
| Setwise-Rank-R1-14BTraining=SFT, Scale (%)=182026.01 | 68.9 | |
| Rank-R1-7BTraining=RL, Scale (%)=182026.01 | 68.5 | |
| ListT5-baseTraining=SFT, Scale (%)=1002026.01 | 68.1 | |
| RocketQAv2-retriever + HybRankreranking_extension=HybRank2023.05 | 67.87 | |
| RocketQAv2-retrieverreranking=HybRank2023.05 | 67.87 | |
| RocketQA-rerankerreranking_extension=none2023.05 | 67.66 | |
| RocketQA-rerankerreranking=None2023.05 | 67.66 | |
| RocketQA-retriever + HybRankreranking_extension=HybRank2023.05 | 67.25 | |
| RocketQA-retrieverreranking=HybRank2023.05 | 67.25 | |
| Setwise-Rank-R1-3BTraining=SFT, Scale (%)=182026.01 | 67.2 | |
| TCT-ColBERT-v1 + HybRankreranking_extension=HybRank2023.05 | 66.91 | |
| TCT-ColBERT-v1reranking=HybRank2023.05 | 66.91 | |
| Rank-R1-3BTraining=RL, Scale (%)=182026.01 | 66.8 | |
| DistilBERT-KD + HybRankreranking_extension=HybRank2023.05 | 66.71 | |
| DistilBERT-KDreranking=HybRank2023.05 | 66.71 | |
| TAS-B + HybRankreranking_extension=HybRank2023.05 | 66.53 | |
| TAS-Breranking=HybRank2023.05 | 66.53 | |
| TCT-ColBERT-v2 + HybRankreranking_extension=HybRank2023.05 | 66.35 | |
| TCT-ColBERT-v2reranking=HybRank2023.05 | 66.35 | |
| Rank-R1-7BTraining=Zeroshot, Scale (%)=1002026.01 | 66.2 | |
| RankVicuna-7bTraining=Zeroshot, Scale (%)=1002026.01 | 66.1 | |
| Rank-R1-14BTraining=Zeroshot, Scale (%)=1002026.01 | 65.2 | |
| Setwise-14BTraining=Zeroshot, Scale (%)=1002026.01 | 64.8 | |
| TCT-ColBERT-v2reranking_extension=none2023.05 | 64.32 | |
| TCT-ColBERT-v2reranking=None2023.05 | 64.32 | |
| TAS-Breranking_extension=none2023.05 | 63.89 | |
| TAS-Breranking=None2023.05 | 63.89 | |
| RocketQA-retrieverreranking_extension=none2023.05 | 63.74 | |
| RocketQA-retrieverreranking=None2023.05 | 63.74 | |
| ANCE + HybRankreranking_extension=HybRank2023.05 | 63.7 | |
| ANCEreranking=HybRank2023.05 | 63.7 | |
| Setwise-Rank-R1-7BTraining=Zeroshot, Scale (%)=1002026.01 | 63.6 | |
| RocketQAv2-retrieverreranking_extension=none2023.05 | 63.04 | |
| RocketQAv2-retrieverreranking=None2023.05 | 63.04 | |
| RankGPT(GPT-3.5)Training=GPT-3.52026.01 | 62.9 | |
| TCT-ColBERT-v1reranking_extension=none2023.05 | 61.03 | |
| TCT-ColBERT-v1reranking=None2023.05 | 61.03 | |
| DistilBERT-KDreranking_extension=none2023.05 | 60.58 | |
| DistilBERT-KDreranking=None2023.05 | 60.58 | |
| ANCEreranking_extension=none2023.05 | 60 | |
| ANCEreranking=None2023.05 | 60 | |
| Rank-R1-3BTraining=Zeroshot, Scale (%)=1002026.01 | 53.8 | |
| BM25Training=Zeroshot, Scale (%)=1002026.01 | 48 | |
| Setwise-Rank-R1-3BTraining=Zeroshot, Scale (%)=1002026.01 | 31.7 |