Reranking on Natural Questions (test)
59.83Recall@1RocketQA-reranker + HybRank
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| RocketQA-reranker + HybRanktype=reranker, reranking=HybRank2023.05 | 59.83 | 78.73 | 82.83 | 86.4 | 88.42 | |
| RocketQAv2-reranker + HybRanktype=reranker, reranking=HybRank2023.05 | 59.5 | 78.34 | 83.24 | 86.26 | 88.75 | |
| RocketQAv2-rerankertype=reranker2023.05 | 57.17 | 75.98 | 81 | 84.71 | 87.92 | |
| RocketQAv2-retriever + HybRanktype=retriever, reranking=HybRank2023.05 | 56.98 | 76.65 | 81.94 | 85.76 | 88.61 | |
| RocketQA-retriever + HybRanktype=retriever, reranking=HybRank2023.05 | 56.07 | 77.04 | 82.3 | 85.68 | 88.17 | |
| RocketQAv2-retrievertype=retriever2023.05 | 55.57 | 75.98 | 81.08 | 84.46 | 87.92 | |
| RocketQA-rerankertype=reranker2023.05 | 54.6 | 76.59 | 81.44 | 85.01 | 88.17 | |
| ANCE + HybRankreranking=HybRank2023.05 | 53.63 | 73.57 | 79.28 | 83.88 | 87.12 | |
| DPR-Single + HybRankreranking=HybRank2023.05 | 53.13 | 73.05 | 78.84 | 82.99 | 85.93 | |
| FiD-KD + HybRankreranking=HybRank2023.05 | 52.85 | 74.46 | 80.5 | 84.49 | 88.06 | |
| ANCE2023.05 | 52.66 | 72.66 | 78.7 | 83.05 | 86.29 | |
| DPR Multi + HybRankreranking=HybRank2023.05 | 51.99 | 72.71 | 79.03 | 83.24 | 85.93 | |
| RocketQA-retrievertype=retriever2023.05 | 51.74 | 74.02 | 80 | 83.99 | 87.34 | |
| FiD-KD2023.05 | 50.36 | 74.1 | 79.78 | 84.27 | 87.9 | |
| DPR-Single2023.05 | 47.95 | 69.39 | 75.93 | 80.97 | 84.9 | |
| DPR Multi2023.05 | 45.82 | 68.12 | 75.23 | 80.31 | 84.57 |