Passage Reranking on News BEIR
49.32NDCG@10RankGPT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RankGPTModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 49.32 | 95.8 | |
| HeadRankModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 46.4 | 100 | |
| RankGPTModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 46.3 | 97.1 | |
| HeadRankModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 46.27 | 100 | |
| QR-RModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 44.46 | 100 | |
| HeadRankModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 44.02 | 100 | |
| QR-RModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 43.89 | 100 | |
| ICRModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 43.47 | 100 | |
| CoReModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 43.32 | 100 | |
| CoReModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 42.71 | 100 | |
| ICRModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 42.69 | 100 | |
| CoReModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 42.55 | 100 | |
| NIAHModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 41.22 | 100 | |
| ICRModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 41.13 | 100 | |
| QR-RModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 40.04 | 100 | |
| BM25 (top40)Model=Baseline, Top-40 retrieval setting=BM252026.04 | 39.52 | 100 | |
| NIAHModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 39.34 | 100 | |
| NIAHModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 38.3 | 100 | |
| RankGPTModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 37.81 | 76.6 |