Passage Reranking on COVID BEIR
73.94NDCG@10HeadRank
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| HeadRankModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 73.94 | 100 | |
| QR-RModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 73.04 | 100 | |
| RankGPTModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 71.12 | 95.8 | |
| HeadRankModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 70.81 | 100 | |
| CoReModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 70.08 | 100 | |
| HeadRankModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 68.71 | 100 | |
| CoReModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 68.67 | 100 | |
| RankGPTModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 68.15 | 97.1 | |
| QR-RModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 67.84 | 100 | |
| QR-RModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 67.77 | 100 | |
| ICRModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 66.63 | 100 | |
| CoReModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 65.53 | 100 | |
| ICRModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 65.42 | 100 | |
| NIAHModel=Qwen3-4B, Top-40 retrieval setting=BM252026.04 | 63.64 | 100 | |
| NIAHModel=Qwen3-1.7B, Top-40 retrieval setting=BM252026.04 | 63.39 | 100 | |
| ICRModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 63.28 | 100 | |
| RankGPTModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 60.28 | 76.6 | |
| NIAHModel=Qwen3-0.6B, Top-40 retrieval setting=BM252026.04 | 59.76 | 100 | |
| BM25 (top40)Model=Baseline, Top-40 retrieval setting=BM252026.04 | 59.47 | 100 |