Reranking on TREC DL 2019 v1 (test)
69.82NDCG@10HeapSort
Evaluation results
| Method | Links | |
|---|---|---|
| HeapSortPrompting Strategy=Randomized, Budget=400, Backbone=Flan-T5-XL2026.05 | 69.82 | |
| Mohajer + BubblePrompting Strategy=Randomized, Budget=400, Backbone=Flan-T5-XL2026.05 | 69.47 | |
| Mohajer + BubblePrompting Strategy=Randomized, Budget=450, Backbone=Flan-T5-XL2026.05 | 69.47 | |
| Mohajer + BubblePrompting Strategy=Randomized, Budget=500, Backbone=Flan-T5-XL2026.05 | 69.47 | |
| Mohajer + BubblePrompting Strategy=Randomized, Budget=350, Backbone=Flan-T5-XL2026.05 | 69.17 | |
| HeapSortPrompting Strategy=Randomized, Budget=350, Backbone=Flan-T5-XL2026.05 | 69.03 | |
| HeapSortPrompting Strategy=Bidirectional, Budget=500, Backbone=Flan-T5-XL2026.05 | 68.92 | |
| HeapSortPrompting Strategy=Randomized, Budget=500, Backbone=Flan-T5-XL2026.05 | 68.84 | |
| HeapSortPrompting Strategy=Randomized, Budget=450, Backbone=Flan-T5-XL2026.05 | 68.76 | |
| MohajerPrompting Strategy=Randomized, Budget=250, Backbone=Flan-T5-XL2026.05 | 68.73 | |
| MohajerPrompting Strategy=Randomized, Budget=300, Backbone=Flan-T5-XL2026.05 | 68.73 | |
| MohajerPrompting Strategy=Randomized, Budget=350, Backbone=Flan-T5-XL2026.05 | 68.73 | |
| MohajerPrompting Strategy=Randomized, Budget=400, Backbone=Flan-T5-XL2026.05 | 68.73 | |
| MohajerPrompting Strategy=Randomized, Budget=450, Backbone=Flan-T5-XL2026.05 | 68.73 | |
| MohajerPrompting Strategy=Randomized, Budget=500, Backbone=Flan-T5-XL2026.05 | 68.73 | |
| Mohajer + BubblePrompting Strategy=Randomized, Budget=200, Backbone=Flan-T5-XL2026.05 | 68.7 | |
| MohajerPrompting Strategy=Randomized, Budget=200, Backbone=Flan-T5-XL2026.05 | 68.7 | |
| Mohajer + BubblePrompting Strategy=Randomized, Budget=300, Backbone=Flan-T5-XL2026.05 | 68.53 | |
| HeapSortPrompting Strategy=Randomized, Budget=300, Backbone=Flan-T5-XL2026.05 | 68.49 | |
| Mohajer + BubblePrompting Strategy=Randomized, Budget=250, Backbone=Flan-T5-XL2026.05 | 67.99 | |
| Mohajer + BubblePrompting Strategy=Randomized, Budget=150, Backbone=Flan-T5-XL2026.05 | 67.79 | |
| MohajerPrompting Strategy=Randomized, Budget=150, Backbone=Flan-T5-XL2026.05 | 67.79 | |
| Mohajer + BubblePrompting Strategy=Bidirectional, Budget=400, Backbone=Flan-T5-XL2026.05 | 66.64 | |
| MohajerPrompting Strategy=Bidirectional, Budget=400, Backbone=Flan-T5-XL2026.05 | 66.64 | |
| Mohajer + BubblePrompting Strategy=Bidirectional, Budget=450, Backbone=Flan-T5-XL2026.05 | 66.59 | |
| Mohajer + BubblePrompting Strategy=Bidirectional, Budget=500, Backbone=Flan-T5-XL2026.05 | 66.59 | |
| MohajerPrompting Strategy=Bidirectional, Budget=450, Backbone=Flan-T5-XL2026.05 | 66.58 | |
| MohajerPrompting Strategy=Bidirectional, Budget=500, Backbone=Flan-T5-XL2026.05 | 66.58 | |
| Mohajer + BubblePrompting Strategy=Bidirectional, Budget=300, Backbone=Flan-T5-XL2026.05 | 66.34 | |
| MohajerPrompting Strategy=Bidirectional, Budget=300, Backbone=Flan-T5-XL2026.05 | 66.34 | |
| Mohajer + BubblePrompting Strategy=Bidirectional, Budget=350, Backbone=Flan-T5-XL2026.05 | 66.23 | |
| MohajerPrompting Strategy=Bidirectional, Budget=350, Backbone=Flan-T5-XL2026.05 | 66.23 | |
| HeapSortPrompting Strategy=Randomized, Budget=250, Backbone=Flan-T5-XL2026.05 | 65.93 | |
| BubbleSortPrompting Strategy=Randomized, Budget=500, Backbone=Flan-T5-XL2026.05 | 65.73 | |
| Mohajer + BubblePrompting Strategy=Bidirectional, Budget=250, Backbone=Flan-T5-XL2026.05 | 65.35 | |
| MohajerPrompting Strategy=Bidirectional, Budget=250, Backbone=Flan-T5-XL2026.05 | 65.35 | |
| QuickSortPrompting Strategy=Randomized, Budget=450, Backbone=Flan-T5-XL2026.05 | 64.83 | |
| BubbleSortPrompting Strategy=Randomized, Budget=450, Backbone=Flan-T5-XL2026.05 | 64.37 | |
| QuickSortPrompting Strategy=Randomized, Budget=500, Backbone=Flan-T5-XL2026.05 | 64.37 | |
| BubbleSortPrompting Strategy=Randomized, Budget=400, Backbone=Flan-T5-XL2026.05 | 64.27 | |
| HeapSortPrompting Strategy=Bidirectional, Budget=450, Backbone=Flan-T5-XL2026.05 | 63.58 | |
| QuickSortPrompting Strategy=Randomized, Budget=400, Backbone=Flan-T5-XL2026.05 | 63 | |
| PAC + BubblePrompting Strategy=Bidirectional, Budget=400, Backbone=Flan-T5-XL2026.05 | 62.6 | |
| PAC + BubblePrompting Strategy=Bidirectional, Budget=450, Backbone=Flan-T5-XL2026.05 | 62.6 | |
| PAC + BubblePrompting Strategy=Bidirectional, Budget=500, Backbone=Flan-T5-XL2026.05 | 62.6 | |
| PAC + BubblePrompting Strategy=Bidirectional, Budget=350, Backbone=Flan-T5-XL2026.05 | 62.59 | |
| BubbleSortPrompting Strategy=Randomized, Budget=350, Backbone=Flan-T5-XL2026.05 | 62.52 | |
| Mohajer + BubblePrompting Strategy=Bidirectional, Budget=200, Backbone=Flan-T5-XL2026.05 | 62.44 | |
| MohajerPrompting Strategy=Bidirectional, Budget=200, Backbone=Flan-T5-XL2026.05 | 62.44 | |
| BubbleSortPrompting Strategy=Randomized, Budget=300, Backbone=Flan-T5-XL2026.05 | 61.98 | |
| QuickSortPrompting Strategy=Randomized, Budget=350, Backbone=Flan-T5-XL2026.05 | 61.44 | |
| Mohajer + BubblePrompting Strategy=Randomized, Budget=100, Backbone=Flan-T5-XL2026.05 | 61.41 | |
| MohajerPrompting Strategy=Randomized, Budget=100, Backbone=Flan-T5-XL2026.05 | 61.41 | |
| PAC + BubblePrompting Strategy=Randomized, Budget=200, Backbone=Flan-T5-XL2026.05 | 61.05 | |
| PAC + BubblePrompting Strategy=Randomized, Budget=250, Backbone=Flan-T5-XL2026.05 | 61.05 | |
| PAC + BubblePrompting Strategy=Randomized, Budget=300, Backbone=Flan-T5-XL2026.05 | 61.05 | |
| PAC + BubblePrompting Strategy=Randomized, Budget=350, Backbone=Flan-T5-XL2026.05 | 61.05 | |
| PAC + BubblePrompting Strategy=Randomized, Budget=400, Backbone=Flan-T5-XL2026.05 | 61.05 | |
| PAC + BubblePrompting Strategy=Randomized, Budget=450, Backbone=Flan-T5-XL2026.05 | 61.05 | |
| PAC + BubblePrompting Strategy=Randomized, Budget=500, Backbone=Flan-T5-XL2026.05 | 61.05 | |
| BubbleSortPrompting Strategy=Bidirectional, Budget=500, Backbone=Flan-T5-XL2026.05 | 60.95 | |
| BubbleSortPrompting Strategy=Bidirectional, Budget=450, Backbone=Flan-T5-XL2026.05 | 60.69 | |
| BubbleSortPrompting Strategy=Bidirectional, Budget=400, Backbone=Flan-T5-XL2026.05 | 60.64 | |
| BubbleSortPrompting Strategy=Randomized, Budget=250, Backbone=Flan-T5-XL2026.05 | 60.33 | |
| PAC + BubblePrompting Strategy=Bidirectional, Budget=300, Backbone=Flan-T5-XL2026.05 | 60 | |
| QuickSortPrompting Strategy=Randomized, Budget=250, Backbone=Flan-T5-XL2026.05 | 59.89 | |
| BubbleSortPrompting Strategy=Randomized, Budget=200, Backbone=Flan-T5-XL2026.05 | 59.77 | |
| QuickSortPrompting Strategy=Bidirectional, Budget=500, Backbone=Flan-T5-XL2026.05 | 59.27 | |
| QuickSortPrompting Strategy=Bidirectional, Budget=450, Backbone=Flan-T5-XL2026.05 | 59.08 | |
| QuickSortPrompting Strategy=Bidirectional, Budget=400, Backbone=Flan-T5-XL2026.05 | 58.85 | |
| QuickSortPrompting Strategy=Bidirectional, Budget=250, Backbone=Flan-T5-XL2026.05 | 58.57 | |
| QuickSortPrompting Strategy=Bidirectional, Budget=300, Backbone=Flan-T5-XL2026.05 | 58.57 | |
| QuickSortPrompting Strategy=Bidirectional, Budget=350, Backbone=Flan-T5-XL2026.05 | 58.57 | |
| QuickSortPrompting Strategy=Randomized, Budget=300, Backbone=Flan-T5-XL2026.05 | 58.42 | |
| PAC + BubblePrompting Strategy=Randomized, Budget=150, Backbone=Flan-T5-XL2026.05 | 58.35 | |
| QuickSortPrompting Strategy=Bidirectional, Budget=200, Backbone=Flan-T5-XL2026.05 | 58.3 | |
| QuickSortPrompting Strategy=Bidirectional, Budget=100, Backbone=Flan-T5-XL2026.05 | 58.08 | |
| QuickSortPrompting Strategy=Bidirectional, Budget=150, Backbone=Flan-T5-XL2026.05 | 58.08 | |
| BubbleSortPrompting Strategy=Bidirectional, Budget=350, Backbone=Flan-T5-XL2026.05 | 57.78 | |
| QuickSortPrompting Strategy=Randomized, Budget=150, Backbone=Flan-T5-XL2026.05 | 57.57 | |
| BubbleSortPrompting Strategy=Bidirectional, Budget=200, Backbone=Flan-T5-XL2026.05 | 57.13 | |
| BubbleSortPrompting Strategy=Bidirectional, Budget=250, Backbone=Flan-T5-XL2026.05 | 57.13 | |
| BubbleSortPrompting Strategy=Bidirectional, Budget=300, Backbone=Flan-T5-XL2026.05 | 57.13 | |
| QuickSortPrompting Strategy=Randomized, Budget=200, Backbone=Flan-T5-XL2026.05 | 56.98 | |
| BubbleSortPrompting Strategy=Randomized, Budget=150, Backbone=Flan-T5-XL2026.05 | 56.88 | |
| QuickSortPrompting Strategy=Randomized, Budget=100, Backbone=Flan-T5-XL2026.05 | 56.33 | |
| BubbleSortPrompting Strategy=Randomized, Budget=100, Backbone=Flan-T5-XL2026.05 | 55.92 | |
| HeapSortPrompting Strategy=Bidirectional, Budget=400, Backbone=Flan-T5-XL2026.05 | 54.14 | |
| BubbleSortPrompting Strategy=Bidirectional, Budget=100, Backbone=Flan-T5-XL2026.05 | 50.58 | |
| BubbleSortPrompting Strategy=Bidirectional, Budget=150, Backbone=Flan-T5-XL2026.05 | 50.58 | |
| PAC + BubblePrompting Strategy=Bidirectional, Budget=100, Backbone=Flan-T5-XL2026.05 | 50.58 | |
| PAC + BubblePrompting Strategy=Bidirectional, Budget=150, Backbone=Flan-T5-XL2026.05 | 50.58 | |
| PAC + BubblePrompting Strategy=Bidirectional, Budget=200, Backbone=Flan-T5-XL2026.05 | 50.58 | |
| PAC + BubblePrompting Strategy=Bidirectional, Budget=250, Backbone=Flan-T5-XL2026.05 | 50.58 | |
| PAC + BubblePrompting Strategy=Randomized, Budget=100, Backbone=Flan-T5-XL2026.05 | 50.58 | |
| HeapSortPrompting Strategy=Randomized, Budget=200, Backbone=Flan-T5-XL2026.05 | 49.27 | |
| HeapSortPrompting Strategy=Bidirectional, Budget=350, Backbone=Flan-T5-XL2026.05 | 41.68 | |
| Mohajer + BubblePrompting Strategy=Bidirectional, Budget=100, Backbone=Flan-T5-XL2026.05 | 32.76 | |
| Mohajer + BubblePrompting Strategy=Bidirectional, Budget=150, Backbone=Flan-T5-XL2026.05 | 32.76 | |
| MohajerPrompting Strategy=Bidirectional, Budget=100, Backbone=Flan-T5-XL2026.05 | 32.76 |