Passage Reranking on TREC Deep Learning 2020
59.89NDCG@10HeadRank
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HeadRankModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 59.89 | 100 | |
| RankGPTModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 59.52 | 95.8 | |
| HeadRankModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 57.85 | 100 | |
| QR-RModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 53.84 | 100 | |
| RankGPTModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 52.77 | 97.1 | |
| HeadRankModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 51.71 | 100 | |
| CoReModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 50.89 | 100 | |
| RankGPTModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 48.54 | 76.6 | |
| ICRModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 48.17 | 100 | |
| BM25 (top40)Model=Baseline, Top-40 retrieval setting=BM252026.04 | 47.96 | 100 | |
| QR-RModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 46.56 | 100 | |
| ICRModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 46.14 | 100 | |
| CoReModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 45.81 | 100 | |
| CoReModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 44.24 | 100 | |
| QR-RModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 43.32 | 100 | |
| NIAHModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 43.25 | 100 | |
| ICRModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 41.75 | 100 | |
| NIAHModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 40.94 | 100 | |
| NIAHModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 38.87 | 100 |