Passage Ranking on TREC DL 2019 (R@10)
100R@10monot5-3B
Evaluation results
| Method | Links | |
|---|---|---|
| monot5-3BSupervision=Supervised, LLM=T5-3B2024.02 | 100 | |
| TARTSupervision=Supervised, LLM=T5-XL2024.02 | 100 | |
| monot5-baseSupervision=Supervised, LLM=T5-base2024.02 | 96.66 | |
| monoBERTSupervision=Supervised, LLM=BERT2024.02 | 96.66 | |
| BinaryBudget=B1, Strategy=Point, LLM=GPT-3.52024.02 | 96.66 | |
| B-PRPBudget=B1, Strategy=Pair, LLM=T5-XL2024.02 | 96.66 | |
| B-PRPBudget=B2, Strategy=Pair, LLM=T5-XL2024.02 | 96.66 | |
| B-PRPBudget=B3, Strategy=Pair, LLM=T5-XL2024.02 | 96.66 | |
| EcoRankBudget=B1, Strategy=Hybr, LLM=T5-XL2024.02 | 95.34 | |
| BM25Supervision=None2024.02 | 93.33 | |
| LikertBudget=B1, Strategy=Point, LLM=T5-XL2024.02 | 93.33 | |
| B-PRPBudget=B1, Strategy=Pair, LLM=GPT-3.52024.02 | 93.33 | |
| LikertBudget=B2, Strategy=Point, LLM=T5-XL2024.02 | 93.33 | |
| LikertBudget=B3, Strategy=Point, LLM=T5-XL2024.02 | 93.33 | |
| BinaryBudget=B1, Strategy=Point, LLM=T5-XL2024.02 | 90 | |
| B-RankGPTBudget=B1, Strategy=List, LLM=GPT-3.52024.02 | 90 | |
| InParsBudget=B1, LLM=T5-large2024.02 | 86.66 | |
| BinaryBudget=B2, Strategy=Point, LLM=T5-XL2024.02 | 86.66 | |
| EcoRankBudget=B2, Strategy=Hybr, LLM=T5-XL+L2024.02 | 86.66 | |
| EcoRank-w/o-casc.Budget=B3, Strategy=Hybr, LLM=T5-XL2024.02 | 86.66 | |
| EcoRankBudget=B3, Strategy=Hybr, LLM=T5-XL+L2024.02 | 86.66 | |
| InParsBudget=B2, LLM=T5-large2024.02 | 83.33 | |
| EcoRank-w/o-casc.Budget=B2, Strategy=Hybr, LLM=T5-XL2024.02 | 83.33 | |
| InParsBudget=B3, LLM=T5-large2024.02 | 83.33 | |
| BinaryBudget=B3, Strategy=Point, LLM=T5-XL2024.02 | 83.33 | |
| B-UPRBudget=B3, Strategy=Point, LLM=T5-XL2024.02 | 83.33 | |
| B-UPRBudget=B1, Strategy=Point, LLM=T5-XL2024.02 | 63.33 | |
| B-UPRBudget=B2, Strategy=Point, LLM=T5-XL2024.02 | 60 |