Passage Reranking on TREC Deep Learning 2019
64.33NDCG@10HeadRank
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HeadRankModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 64.33 | 100 | |
| RankGPTModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 63.58 | 95.8 | |
| HeadRankModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 61.32 | 100 | |
| HeadRankModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 59.93 | 100 | |
| QR-RModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 57.45 | 100 | |
| CoReModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 56.67 | 100 | |
| RankGPTModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 56.32 | 97.1 | |
| ICRModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 54.38 | 100 | |
| QR-RModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 52.36 | 100 | |
| ICRModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 52.11 | 100 | |
| QR-RModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 51.96 | 100 | |
| CoReModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 51.26 | 100 | |
| BM25 (top40)Model=Baseline, Top-40 retrieval setting=BM252026.04 | 50.58 | 100 | |
| CoReModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 50.46 | 100 | |
| ICRModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 50.09 | 100 | |
| RankGPTModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 49.17 | 76.6 | |
| NIAHModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 48.98 | 100 | |
| NIAHModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 48.13 | 100 | |
| NIAHModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 46.55 | 100 |