Document Reranking on TREC DL 2019 (test)
74.4NDCG@10EviRerankBM25
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| EviRerankBM25Model Category=Ours: EviRerank (AEB+SA), Selector=BM252024.11 | 74.4 | 30.2 | |
| EviRerankcrossModel Category=Ours: EviRerank (AEB+SA), Selector=cross2024.11 | 74.3 | 30.7 | |
| EviRerankbiModel Category=Ours: EviRerank (AEB+SA), Selector=bi2024.11 | 74.3 | 30 | |
| RankLLaMAModel Category=LLM2024.11 | 70.1 | 28.8 | |
| KeyB(BERT)BinBModel Category=Select blocks models, Selector=BinB2024.11 | 69.7 | 28.3 | |
| RankLLaMA-prefixModel Category=LLM, pmax=6002024.11 | 69.2 | 28.1 | |
| KeyB(BERT)BM25Model Category=Select blocks models, Selector=BM252024.11 | 68.3 | 28.1 | |
| IDCMModel Category=Select blocks models2024.11 | 67.9 | 27.3 | |
| KeyB(PARADE5)BinB2Model Category=Select blocks models, Selector=BinB22024.11 | 67.8 | 27.9 | |
| KeyB(PARADE5)BinBModel Category=Select blocks models, Selector=BinB2024.11 | 67.6 | 27.7 | |
| KeyB(PARADE5)BM25Model Category=Select blocks models, Selector=BM252024.11 | 67.2 | 28 | |
| QDS-TransformerModel Category=Sparse attention models2024.11 | 66.7 | 27.8 | |
| PARADEModel Category=Baseline models2024.11 | 65.5 | 28 | |
| RankLLaMA-AvgPModel Category=LLM, Aggregation Strategy=AvgP2024.11 | 65.4 | 26.4 | |
| Transformer-XHModel Category=Sparse attention models2024.11 | 64.6 | 25.6 | |
| TKLModel Category=Baseline models2024.11 | 64.4 | 27.7 | |
| RankLLaMA-MaxPModel Category=LLM, Aggregation Strategy=MaxP2024.11 | 64.3 | 26.9 | |
| Sparse-TransformerModel Category=Sparse attention models2024.11 | 63.4 | 25.7 | |
| Longformer-QAModel Category=Sparse attention models2024.11 | 62.7 | 25.5 | |
| BM25Model Category=Baseline models2024.11 | 48.8 | 23.4 |