Reranking on DL-20
58.5MAPSliding Window
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Sliding WindowFirst-stage Retriever=SPLADE, Reranking Strategy=Sliding2026.04 | 58.5 | 79.9 | 1 | |
| GPTD-PartFirst-stage Retriever=SPLADE, Reranking Strategy=GPTD-Part2026.04 | 56 | 78.5 | 1.48 | |
| VS-SlidingFirst-stage Retriever=SPLADE, Reranking Strategy=VS-Sliding2026.04 | 55.5 | 76.6 | 1.78 | |
| SNOWFirst-stage Retriever=SPLADE, Reranking Strategy=SNOW2026.04 | 54.4 | 81 | 2.77 | |
| TDPartFirst-stage Retriever=SPLADE, Reranking Strategy=TDPart2026.04 | 54 | 77.3 | 1.48 | |
| SPLADEFirst-stage Retriever=SPLADE, Reranking Strategy=None2026.04 | 50.5 | 72.1 | — | |
| VS-SlidingFirst-stage Retriever=BM25, Reranking Strategy=VS-Sliding2026.04 | 41.1 | 69.2 | 1.73 | |
| Sliding WindowFirst-stage Retriever=BM25, Reranking Strategy=Sliding2026.04 | 39.2 | 70.5 | 1 | |
| SNOWFirst-stage Retriever=BM25, Reranking Strategy=SNOW2026.04 | 38.5 | 69 | 2.77 | |
| GPTD-PartFirst-stage Retriever=BM25, Reranking Strategy=GPTD-Part2026.04 | 38.1 | 67.1 | 1.48 | |
| TDPartFirst-stage Retriever=BM25, Reranking Strategy=TDPart2026.04 | 34.5 | 65.9 | 1.48 | |
| BM25First-stage Retriever=BM25, Reranking Strategy=None2026.04 | 27.5 | 49.4 | — |