Document Reranking on TREC DL 20
72.75NDCG@10BracketRank -20
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BracketRank -20Model=GPT-42026.04 | 72.75 | 75.85 | — | |
| TourRankModel=GPT-42026.04 | 69.79 | 72.46 | — | |
| TourRankModel=GPT3.52026.04 | 69.56 | 72.49 | — | |
| RankGPTModel=GPT-42026.04 | 69.48 | 72.32 | — | |
| monoT5Model=T5 (3B)2026.04 | 68.89 | 72.32 | — | |
| RRKDoc Length=20482026.04 | 68.6 | — | 1 | |
| RRKDoc Length=5122026.04 | 67.7 | — | 1 | |
| BracketRank -15Model=GPT-42026.04 | 67.56 | 75.25 | — | |
| MBerTDoc Length=20482026.04 | 67.4 | — | 8 | |
| monoBERTModel=BERT (340M)2026.04 | 67.28 | 70.74 | — | |
| RRK-MSDoc Length=20482026.04 | 67 | — | 1 | |
| RRKDoc Length=10242026.04 | 67 | — | 1 | |
| monoT5 (220M)Model=T5 (220M)2026.04 | 66.99 | 69.4 | — | |
| Qwen3 4BDoc Length=20482026.04 | 66.9 | — | 35 | |
| RRK-MSDoc Length=10242026.04 | 66.5 | — | 1 | |
| PRP-AllpairModel=GPT3.52026.04 | 66.4 | 69.75 | — | |
| MBerTDoc Length=10242026.04 | 66.4 | — | 7 | |
| MBerTDoc Length=5122026.04 | 66.3 | — | 6 | |
| RRK-MSDoc Length=5122026.04 | 66.1 | — | 1 | |
| Jina-v3Doc Length=20482026.04 | 64.5 | — | 59 | |
| BracketRank -10Model=GPT-42026.04 | 64.04 | 75.29 | — | |
| Qwen3 0.6BDoc Length=20482026.04 | 63.7 | — | 10 | |
| RankGPTModel=GPT3.52026.04 | 63.6 | 67.25 | — | |
| B-RGModel=GPT3.52026.04 | 63.37 | 65.04 | — | |
| Qwen3 4BDoc Length=10242026.04 | 62.8 | — | 20 | |
| Jina-v3Doc Length=10242026.04 | 62.6 | — | 24 | |
| Jina-v3Doc Length=5122026.04 | 60 | — | 12 | |
| Qwen3 0.6BDoc Length=10242026.04 | 59.4 | — | 6 | |
| Qwen3 4BDoc Length=5122026.04 | 58.5 | — | 13 | |
| Qwen3 0.6BDoc Length=5122026.04 | 55 | — | 4 | |
| Setwise.bubblesort (c=10)Model=GPT3.52026.04 | 53.82 | 57.03 | — | |
| Setwise.heapsort (c=10)Model=GPT3.52026.04 | 53.73 | 57.05 | — | |
| BM25Model=-2026.04 | 47.96 | 50.67 | — |