Document Reranking on TREC DL 2022
44.88NDCG@10EviRerank
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| EviRerankSelector=cross2024.11 | 44.88 | — | 11.51 | |
| EviRerankSelector=bi2024.11 | 44.12 | — | 11.47 | |
| EviRerankSelector=BM252024.11 | 43.07 | — | 11.19 | |
| SumRankparameters=7B2026.03 | 42.74 | 10.96 | — | |
| SumRankparameters=3B2026.03 | 42.22 | 10.67 | — | |
| FirstPtruncation_length=1282026.03 | 40.82 | 10.11 | — | |
| FirstPtruncation_length=2562026.03 | 40.66 | 10.46 | — | |
| PEGASUS2026.03 | 40.46 | 10.13 | — | |
| LED-summarizer2026.03 | 40.18 | 10.11 | — | |
| BART-summarizer2026.03 | 40.07 | 10.13 | — | |
| FirstPtruncation_length=5122026.03 | 39.82 | 10.11 | — | |
| RankLLaMA2024.11 | 38.45 | — | 10.19 | |
| Qwen2.5-Instructparameters=3B2026.03 | 37.17 | 9.5 | — | |
| Qwen2.5-Instructparameters=7B2026.03 | 35.4 | 9.15 | — | |
| RankLLaMAStrategy=AvgP2024.11 | 34.3 | — | 9.84 | |
| BM252026.03 | 29.93 | 8.01 | — | |
| BM252024.11 | 29.9 | — | 8 | |
| RankLLaMAStrategy=MaxP2024.11 | 22.48 | — | 7.07 |