Passage Ranking on TREC DL 2020 (R@10)
100R@10monot5-base
Evaluation results
| Method | Links | |
|---|---|---|
| monot5-baseSupervision=Supervised, LLM=T5-base2024.02 | 100 | |
| monot5-3BSupervision=Supervised, LLM=T5-3B2024.02 | 100 | |
| monoBERTSupervision=Supervised, LLM=BERT2024.02 | 100 | |
| InParsBudget=B2, LLM=T5-large2024.02 | 100 | |
| TARTSupervision=Supervised, LLM=T5-XL2024.02 | 97.72 | |
| InParsBudget=B1, LLM=T5-large2024.02 | 97.72 | |
| InParsBudget=B3, LLM=T5-large2024.02 | 97.72 | |
| BinaryBudget=B1, Strategy=Point, LLM=T5-XL2024.02 | 95.45 | |
| B-PRPBudget=B1, Strategy=Pair, LLM=T5-XL2024.02 | 95.45 | |
| EcoRankBudget=B1, Strategy=Hybr, LLM=T5-XL2024.02 | 95.45 | |
| BinaryBudget=B2, Strategy=Point, LLM=T5-XL2024.02 | 95.45 | |
| B-PRPBudget=B2, Strategy=Pair, LLM=T5-XL2024.02 | 95.45 | |
| EcoRank-w/o-casc.Budget=B2, Strategy=Hybr, LLM=T5-XL2024.02 | 95.45 | |
| EcoRankBudget=B2, Strategy=Hybr, LLM=T5-XL+L2024.02 | 95.45 | |
| BinaryBudget=B3, Strategy=Point, LLM=T5-XL2024.02 | 95.45 | |
| B-PRPBudget=B3, Strategy=Pair, LLM=T5-XL2024.02 | 95.45 | |
| LikertBudget=B1, Strategy=Point, LLM=T5-XL2024.02 | 93.18 | |
| LikertBudget=B2, Strategy=Point, LLM=T5-XL2024.02 | 93.18 | |
| BM25Supervision=None2024.02 | 92.15 | |
| BinaryBudget=B1, Strategy=Point, LLM=GPT-3.52024.02 | 90.9 | |
| B-RankGPTBudget=B1, Strategy=List, LLM=GPT-3.52024.02 | 90.9 | |
| LikertBudget=B3, Strategy=Point, LLM=T5-XL2024.02 | 90.9 | |
| EcoRank-w/o-casc.Budget=B3, Strategy=Hybr, LLM=T5-XL2024.02 | 90.9 | |
| EcoRankBudget=B3, Strategy=Hybr, LLM=T5-XL+L2024.02 | 90.9 | |
| B-PRPBudget=B1, Strategy=Pair, LLM=GPT-3.52024.02 | 86.36 | |
| B-UPRBudget=B3, Strategy=Point, LLM=T5-XL2024.02 | 77.27 | |
| B-UPRBudget=B2, Strategy=Point, LLM=T5-XL2024.02 | 61.36 | |
| B-UPRBudget=B1, Strategy=Point, LLM=T5-XL2024.02 | 59.09 |