Passage Reranking on DBPedia BEIR
41.34NDCG@10RankGPT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RankGPTModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 41.34 | 95.8 | |
| HeadRankModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 37.24 | 100 | |
| HeadRankModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 37.06 | 100 | |
| HeadRankModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 37.02 | 100 | |
| RankGPTModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 36.44 | 97.1 | |
| QR-RModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 36.27 | 100 | |
| CoReModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 35.84 | 100 | |
| CoReModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 34.39 | 100 | |
| CoReModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 34.2 | 100 | |
| QR-RModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 33.36 | 100 | |
| ICRModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 33.24 | 100 | |
| QR-RModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 33.22 | 100 | |
| ICRModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 32.81 | 100 | |
| ICRModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 32.57 | 100 | |
| RankGPTModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 32.18 | 76.6 | |
| NIAHModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 32.15 | 100 | |
| NIAHModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 31.82 | 100 | |
| BM25 (top40)Model=Baseline, Top-40 retrieval setting=BM252026.04 | 31.8 | 100 | |
| NIAHModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 30.82 | 100 |