Document Reranking on TREC DL 2019
75.59NDCG@10RankGPT-4
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RankGPT-4Ret.=3×BM252026.04 | 75.59 | — | |
| BracketRank -20Model=GPT-42026.04 | 75.11 | 77.9 | |
| ResRankswRet.=8×BM252026.04 | 74.57 | — | |
| RankZephyrRet.=8×BM252026.04 | 74.2 | — | |
| TourRankModel=GPT-42026.04 | 74.13 | 75.57 | |
| ResRankRet.=8×BM252026.04 | 73.59 | — | |
| RankGPTModel=GPT-42026.04 | 72.67 | 75.98 | |
| monoT5Model=T5 (3B)2026.04 | 71.83 | 73.74 | |
| monoT5Ret.=2×BM252026.04 | 71.83 | — | |
| ListT5-baseRet.=8×BM252026.04 | 71.8 | — | |
| ListT5-3BRet.=8×BM252026.04 | 71.8 | — | |
| RankMistralRet.=8×BM252026.04 | 71.73 | — | |
| BracketRank -15Model=GPT-42026.04 | 71.65 | 77.53 | |
| TourRankModel=GPT3.52026.04 | 71.63 | 73.83 | |
| TourRankRet.=3×BM252026.04 | 71.63 | — | |
| monoT5 (220M)Model=T5 (220M)2026.04 | 71.48 | 73.77 | |
| MohajerBase Model=Qwen3-4B-Instruct, Comparison Mode=Randomized2026.05 | 70.98 | — | |
| QuickSortBase Model=Qwen3-4B-Instruct, Comparison Mode=Bidirectional2026.05 | 70.7 | — | |
| monoBERTModel=BERT (340M)2026.04 | 70.5 | 73.25 | |
| monoBERTRet.=2×BM252026.04 | 70.5 | — | |
| Mohajer + BubbleBase Model=Qwen3-4B-Instruct, Comparison Mode=Bidirectional2026.05 | 70.49 | — | |
| PE-RankRet.=8×BM252026.04 | 70.48 | — | |
| MohajerBase Model=Qwen3-4B-Instruct, Comparison Mode=Bidirectional2026.05 | 70.43 | — | |
| HeapSortBase Model=Qwen3-4B-Instruct, Comparison Mode=Bidirectional2026.05 | 70.26 | — | |
| Mohajer + BubbleBase Model=Qwen3-4B-Instruct, Comparison Mode=Randomized2026.05 | 70.26 | — | |
| RankGPTModel=GPT3.52026.04 | 68.19 | 72.05 | |
| PRP-AllpairModel=GPT3.52026.04 | 68.18 | 70.43 | |
| Setwise.heapsort (c=10)Model=GPT3.52026.04 | 68.16 | 70.55 | |
| BubbleSortBase Model=Qwen3-4B-Instruct, Comparison Mode=Bidirectional2026.05 | 67.44 | — | |
| RankVicunaRet.=8×BM252026.04 | 66.82 | — | |
| Setwise.bubblesort (c=10)Model=GPT3.52026.04 | 66.19 | 67.62 | |
| RankGPT-3.5Ret.=3×BM252026.04 | 65.8 | — | |
| BracketRank -10Model=GPT-42026.04 | 65.66 | 79.15 | |
| PAC + BubbleBase Model=Qwen3-4B-Instruct, Comparison Mode=Bidirectional2026.05 | 64.25 | — | |
| PAC + BubbleBase Model=Qwen3-4B-Instruct, Comparison Mode=Randomized2026.05 | 63.02 | — | |
| B-RGModel=GPT3.52026.04 | 62.51 | 63.33 | |
| BM25Base Model=Oracle Ranker2026.05 | 50.6 | — | |
| BM25Model=-2026.04 | 50.58 | 52.78 | |
| BM25Ret.=–2026.04 | 50.58 | — |