Passage Reranking on ArguAna BEIR
36.59NDCG@10HeadRank
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HeadRankModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 36.59 | 100 | |
| HeadRankModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 35.3 | 100 | |
| HeadRankModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 34.62 | 100 | |
| CoReModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 34.59 | 100 | |
| QR-RModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 34.39 | 100 | |
| NIAHModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 33.87 | 100 | |
| CoReModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 33.61 | 100 | |
| QR-RModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 33.52 | 100 | |
| NIAHModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 33 | 100 | |
| CoReModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 32.93 | 100 | |
| ICRModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 32.43 | 100 | |
| QR-RModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 32.35 | 100 | |
| ICRModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 30.63 | 100 | |
| BM25 (top40)Model=Baseline, Top-40 retrieval setting=BM252026.04 | 29.99 | 100 | |
| RankGPTModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 27.72 | 95.8 | |
| RankGPTModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 27.47 | 97.1 | |
| RankGPTModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 26.44 | 76.6 | |
| NIAHModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 24.91 | 100 | |
| ICRModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 23.68 | 100 |