Reranking on MultiConIR (test)
81.6Q1 ScorePure Rerank
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Pure RerankModel=Qwen3-Reranker-4B2026.06 | 81.6 | 89.5 | 89.8 | 86.3 | 81.7 | 76.7 | 70.4 | 63.2 | 55.5 | 46.3 | 68.6 | |
| Decomp-MergeModel=Qwen3-Reranker-4B2026.06 | 81.6 | 89.5 | 89.8 | 89.6 | 86.2 | 81.5 | 77.7 | 71.6 | 64.2 | 57.1 | 75.4 | |
| Pure RerankModel=Qwen3-Reranker-8B2026.06 | 81.3 | 90.8 | 92.1 | 90.3 | 86.9 | 82.1 | 76.5 | 68.8 | 60.8 | 51.9 | 73.9 | |
| Decomp-MergeModel=Qwen3-Reranker-8B2026.06 | 81.3 | 90.8 | 92.1 | 91.6 | 88.4 | 85.2 | 81.2 | 75.7 | 70 | 66.6 | 79.8 | |
| Pure RerankModel=Qwen3-Reranker-0.6B2026.06 | 79.6 | 86.9 | 86.4 | 82.3 | 77.8 | 72 | 67.7 | 58.1 | 50.8 | 40.2 | 64.1 | |
| Decomp-MergeModel=Qwen3-Reranker-0.6B2026.06 | 79.6 | 86.9 | 86.4 | 87.4 | 83.5 | 78.2 | 75.4 | 67.4 | 59.3 | 50.8 | 71.7 | |
| Orig. BaseModel=Qwen3-Reranker-0.6B2026.06 | 69.8 | 80.7 | 84.7 | 84.2 | 81.5 | 77.1 | 72 | 64.8 | 55.8 | 42.3 | 68.2 | |
| Orig. BaseModel=Qwen3-Reranker-4B2026.06 | 69.8 | 80.7 | 84.7 | 84.2 | 81.5 | 77.1 | 72 | 64.8 | 55.8 | 42.3 | 68.2 | |
| Orig. BaseModel=Qwen3-Reranker-8B2026.06 | 69.8 | 80.7 | 84.7 | 84.2 | 81.5 | 77.1 | 72 | 64.8 | 55.8 | 42.3 | 68.2 |