Passage Retrieval on Natural Questions (NQ)
66.59Top-10 Accuracymonot5-3B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| monot5-3BSupervision=Supervised, LLM=T5-3B2024.02 | 66.59 | — | — | |
| EcoRankSupervision=Unsupervised, Budget=B1, Strategy=Hybr, LLM=T5-XL2024.02 | 65.45 | — | — | |
| monoBERTSupervision=Supervised, LLM=BERT2024.02 | 65.18 | — | — | |
| monot5-baseSupervision=Supervised, LLM=T5-base2024.02 | 64.65 | — | — | |
| TARTSupervision=Supervised, LLM=T5-XL2024.02 | 64.37 | — | — | |
| BinarySupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=T5-XL2024.02 | 64.37 | — | — | |
| B-PRPSupervision=Unsupervised, Budget=B1, Strategy=Pair, LLM=T5-XL2024.02 | 63.71 | — | — | |
| InParsSupervision=Unsupervised, Budget=B2, LLM=T5-large2024.02 | 63.51 | — | — | |
| InParsSupervision=Unsupervised, Budget=B3, LLM=T5-large2024.02 | 63.24 | — | — | |
| LikertSupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=T5-XL2024.02 | 63.07 | — | — | |
| EcoRankSupervision=Unsupervised, Budget=B2, Strategy=Hybr, LLM=T5-XL+L2024.02 | 62.46 | — | — | |
| InParsSupervision=Unsupervised, Budget=B1, LLM=T5-large2024.02 | 62.4 | — | — | |
| LikertSupervision=Unsupervised, Budget=B2, Strategy=Point, LLM=T5-XL2024.02 | 61.57 | — | — | |
| BinarySupervision=Unsupervised, Budget=B2, Strategy=Point, LLM=T5-XL2024.02 | 60.72 | — | — | |
| LikertSupervision=Unsupervised, Budget=B3, Strategy=Point, LLM=T5-XL2024.02 | 59.11 | — | — | |
| B-RankGPTSupervision=Unsupervised, Budget=B1, Strategy=List, LLM=GPT-3.52024.02 | 58.33 | — | — | |
| EcoRank-w/o-casc.Supervision=Unsupervised, Budget=B2, Strategy=Hybr, LLM=T5-XL2024.02 | 58.31 | — | — | |
| BinarySupervision=Unsupervised, Budget=B3, Strategy=Point, LLM=T5-XL2024.02 | 58.31 | — | — | |
| BinarySupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=GPT-3.52024.02 | 58.19 | — | — | |
| B-PRPSupervision=Unsupervised, Budget=B2, Strategy=Pair, LLM=T5-XL2024.02 | 57.72 | — | — | |
| EcoRankSupervision=Unsupervised, Budget=B3, Strategy=Hybr, LLM=T5-XL+L2024.02 | 57.72 | — | — | |
| EcoRank-w/o-casc.Supervision=Unsupervised, Budget=B3, Strategy=Hybr, LLM=T5-XL2024.02 | 56.28 | — | — | |
| BM25Supervision=None2024.02 | 54.45 | — | — | |
| B-PRPSupervision=Unsupervised, Budget=B3, Strategy=Pair, LLM=T5-XL2024.02 | 54.45 | — | — | |
| B-UPRSupervision=Unsupervised, Budget=B3, Strategy=Point, LLM=T5-XL2024.02 | 53.51 | — | — | |
| B-PRPSupervision=Unsupervised, Budget=B1, Strategy=Pair, LLM=GPT-3.52024.02 | 52 | — | — | |
| B-UPRSupervision=Unsupervised, Budget=B2, Strategy=Point, LLM=T5-XL2024.02 | 49.55 | — | — | |
| B-UPRSupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=T5-XL2024.02 | 48.45 | — | — | |
| ANCETraining Setting=Single Task2020.07 | — | 81.9 | 87.5 | |
| ANCETraining Setting=Multi Task2020.07 | — | 82.1 | 87.9 | |
| BM25Training Setting=Single Task2020.07 | — | 59.1 | 73.7 | |
| BM25+DPRTraining Setting=Single Task2020.07 | — | 76.6 | 83.8 | |
| BM25+DPRTraining Setting=Multi Task2020.07 | — | 78 | 83.9 | |
| DPRTraining Setting=Single Task2020.07 | — | 78.4 | 85.4 | |
| DPRTraining Setting=Multi Task2020.07 | — | 79.4 | 86 |