Document Reranking on NovelEval 2306
86.42nDCG@1BracketRank
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BracketRankModel=GPT-4, prev.=BM25, Top-K=1002026.04 | 86.42 | 89.39 | 90.47 | 88.76 | |
| RankGPT-4prev.=RankGPT-3.5, Top-K=202026.04 | 85.71 | 87.49 | 90.45 | 87.88 | |
| monoT5Parameters=220M, prev.=BM25, Top-K=1002026.04 | 83.33 | 77.46 | 81.27 | 80.69 | |
| monoT5Parameters=3B, prev.=BM25, Top-K=1002026.04 | 83.33 | 78.38 | 84.62 | 82.11 | |
| monoBERTParameters=340M, prev.=BM25, Top-K=1002026.04 | 78.57 | 70.65 | 77.27 | 75.5 | |
| RankGPT-3.5prev.=BM25, Top-K=1002026.04 | 76.19 | 74.15 | 75.71 | 75.35 | |
| BM252026.04 | 33.33 | 45.96 | 55.77 | 45.02 |