Document Reranking on TREC DL 2023
47.5NDCG@10EviRerankcross
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| EviRerankcrossModel Category=Ours: EviRerank (AEB+SA), Selector Method=cross2024.11 | 47.5 | — | 15.7 | |
| EviRerankbiModel Category=Ours: EviRerank (AEB+SA), Selector Method=bi2024.11 | 46.5 | — | 15.6 | |
| EviRerankBM25Model Category=Ours: EviRerank (AEB+SA), Selector Method=BM252024.11 | 45.7 | — | 15.4 | |
| SumRankparameters=7B2026.03 | 44.31 | 14.95 | — | |
| SumRankparameters=3B2026.03 | 43.76 | 14.85 | — | |
| FirstPtruncation_length=1282026.03 | 42.39 | 14.07 | — | |
| PEGASUS2026.03 | 41.84 | 14.28 | — | |
| BART-summarizer2026.03 | 41.66 | 14.32 | — | |
| FirstPtruncation_length=2562026.03 | 41.58 | 13.94 | — | |
| LED-summarizer2026.03 | 41.36 | 14.11 | — | |
| FirstPtruncation_length=5122026.03 | 41.14 | 13.92 | — | |
| Qwen2.5-Instructparameters=7B2026.03 | 40.24 | 13.5 | — | |
| RankLLaMAModel Category=LLM2024.11 | 38.6 | — | 13.3 | |
| KeyB(BERT)BinBModel Category=Baseline models, Backbone=BERT, Selector Method=BinB2024.11 | 36.4 | — | 12.8 | |
| Qwen2.5-Instructparameters=3B2026.03 | 35.52 | 12.7 | — | |
| KeyB(BERT)BM25Model Category=Baseline models, Backbone=BERT, Selector Method=BM252024.11 | 35.2 | — | 12.3 | |
| RankLLaMA-AvgPModel Category=LLM, Pooling/Aggregation Strategy=AvgP2024.11 | 34.9 | — | 11.7 | |
| RankLLaMA-MaxPModel Category=LLM, Pooling/Aggregation Strategy=MaxP2024.11 | 34.1 | — | 11.2 | |
| BM25Model Category=Baseline models2024.11 | 29.5 | — | 10.5 | |
| BM252026.03 | 29.46 | 10.46 | — |