Reranking on Natural Questions (NQ) (test)
59.83R@1HybRank
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HybRankBase Model=RocketQA-reranker, Ranking Strategy=HybRank2023.05 | 59.83 | — | — | 78.73 | 86.4 | |
| HybRankBase Model=RocketQAv2-reranker, Ranking Strategy=HybRank2023.05 | 59.5 | — | — | 78.34 | 86.26 | |
| RocketQAv2-rerankerBase Model=RocketQAv2-reranker, Ranking Strategy=Original2023.05 | 57.17 | — | — | 75.98 | 84.71 | |
| HybRankBase Model=RocketQAv2-retriever, Ranking Strategy=HybRank2023.05 | 56.98 | — | — | 76.65 | 85.76 | |
| HybRankBase Model=RocketQA-retriever, Ranking Strategy=HybRank2023.05 | 56.07 | — | — | 77.04 | 85.68 | |
| RocketQAv2-retrieverBase Model=RocketQAv2-retriever, Ranking Strategy=Original2023.05 | 55.57 | — | — | 75.98 | 84.46 | |
| RocketQA-rerankerBase Model=RocketQA-reranker, Ranking Strategy=Original2023.05 | 54.6 | — | — | 76.59 | 85.01 | |
| HybRankBase Model=ANCE, Ranking Strategy=HybRank2023.05 | 53.63 | — | — | 73.57 | 83.88 | |
| HybRankBase Model=DPR-Single, Ranking Strategy=HybRank2023.05 | 53.13 | — | — | 73.05 | 82.99 | |
| HybRankBase Model=FiD-KD, Ranking Strategy=HybRank2023.05 | 52.85 | — | — | 74.46 | 84.49 | |
| ANCEBase Model=ANCE, Ranking Strategy=Original2023.05 | 52.66 | — | — | 72.66 | 83.05 | |
| HybRankBase Model=DPR-Multi, Ranking Strategy=HybRank2023.05 | 51.99 | — | — | 72.71 | 83.24 | |
| RocketQA-retrieverBase Model=RocketQA-retriever, Ranking Strategy=Original2023.05 | 51.74 | — | — | 74.02 | 83.99 | |
| FiD-KDBase Model=FiD-KD, Ranking Strategy=Original2023.05 | 50.36 | — | — | 74.1 | 84.27 | |
| DPR-SingleBase Model=DPR-Single, Ranking Strategy=Original2023.05 | 47.95 | — | — | 69.39 | 80.97 | |
| DPR-MultiBase Model=DPR-Multi, Ranking Strategy=Original2023.05 | 45.82 | — | — | 68.12 | 80.31 | |
| BART-GST-AProjection=attention, Graph=AMR2023.05 | — | 24.7 | 48.2 | — | — | |
| BART-GST-MProjection=MLP, Graph=AMR2023.05 | — | 25 | 48.7 | — | — | |
| BART-rerankerBackbone=BART2023.05 | — | 23.3 | 45.8 | — | — | |
| w/o reranker2023.05 | — | 18 | 34.6 | — | — |