Passage Reranking on SciDocs BEIR
16.96NDCG@10HeadRank
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HeadRankModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 16.96 | 100 | |
| HeadRankModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 16.89 | 100 | |
| RankGPTModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 16.68 | 95.8 | |
| CoReModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 16.57 | 100 | |
| CoReModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 16.52 | 100 | |
| RankGPTModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 16.46 | 97.1 | |
| HeadRankModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 16.36 | 100 | |
| QR-RModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 16 | 100 | |
| QR-RModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 15.98 | 100 | |
| ICRModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 15.59 | 100 | |
| CoReModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 15.48 | 100 | |
| NIAHModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 15.44 | 100 | |
| BM25 (top40)Model=Baseline, Top-40 retrieval setting=BM252026.04 | 14.9 | 100 | |
| NIAHModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 14.69 | 100 | |
| RankGPTModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 14.6 | 76.6 | |
| NIAHModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 14.58 | 100 | |
| ICRModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 14.47 | 100 | |
| QR-RModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 13.93 | 100 | |
| ICRModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 13.75 | 100 |