Reranking on BEIR 1.0.0 (test)
84.63Covid Reranking ScoreRank-R1
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Rank-R1Model category=Reasoning reranker, Parameters=14B, Base retriever=BM25, Reranking depth=top-1002025.08 | 84.63 | 44.05 | 75.96 | 38.58 | 32.95 | 56.91 | 49.2 | 54.61 | |
| Rank-R1Model category=Reasoning reranker, Parameters=7B, Base retriever=BM25, Reranking depth=top-1002025.08 | 83.71 | 42.27 | 72.16 | 38.94 | 33.08 | 54.46 | 50.6 | 53.6 | |
| ReasonRankModel category=Reasoning reranker, Parameters=32B, Base retriever=BM25, Reranking depth=top-1002025.08 | 83.16 | 45.65 | 77.24 | 40.04 | 31.07 | 58.67 | 52.24 | 55.44 | |
| RankZephyrModel category=Non-reasoning reranker, Parameters=7B, Base retriever=BM25, Reranking depth=top-1002025.08 | 82.92 | 44.42 | 75.42 | 38.26 | 31.41 | 53.73 | 52.8 | 54.14 | |
| ReasonRankModel category=Reasoning reranker, Parameters=7B, Base retriever=BM25, Reranking depth=top-1002025.08 | 82.01 | 46.03 | 75.55 | 39.6 | 31.36 | 55.4 | 50.5 | 54.35 | |
| RearankModel category=Reasoning reranker, Parameters=7B, Base retriever=BM25, Reranking depth=top-1002025.08 | 81.28 | 44.99 | 75.02 | 38.83 | 32.69 | 56.16 | 51.04 | 54.29 | |
| Rank1Model category=Reasoning reranker, Parameters=32B, Base retriever=BM25, Reranking depth=top-1002025.08 | 80.59 | 34.79 | 74.78 | 37.29 | 25.58 | 58.3 | 45.57 | 50.99 | |
| RankT5Model category=Non-reasoning reranker, Parameters=3B, Base retriever=BM25, Reranking depth=top-1002025.08 | 80.19 | 44.85 | 74.6 | 37.4 | 31.73 | 51.45 | 49.11 | 52.76 | |
| Rank1Model category=Reasoning reranker, Parameters=7B, Base retriever=BM25, Reranking depth=top-1002025.08 | 79.04 | 35.79 | 73.32 | 37.52 | 25.41 | 57.11 | 47.67 | 50.84 | |
| Rank-KModel category=Reasoning reranker, Parameters=32B, Base retriever=BM25, Reranking depth=top-1002025.08 | 74.76 | 38.29 | 60.83 | 36.48 | 32.64 | 49.79 | 45.59 | 48.34 | |
| BM25Model category=Retrieval Baseline2025.08 | 59.47 | 31.8 | 67.89 | 33.75 | 33.04 | 40.7 | 39.52 | 43.74 |