Passage Ranking on R2MED
46.8Biology ScoreReasonRank
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ReasonRankModel Scale=7B, Reranker Type=Reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 46.8 | 59.7 | 60.11 | 16.48 | 24.92 | 39.21 | 39.13 | 29.85 | 39.53 | |
| ReasonRankModel Scale=32B, Reranker Type=Reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 45.56 | 67.73 | 63.45 | 18.9 | 30.6 | 41.08 | 46.11 | 29.35 | 42.85 | |
| Rank-R1Model Scale=14B, Reranker Type=Reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 38.78 | 53.81 | 57.94 | 15.15 | 25.49 | 40.57 | 42.52 | 29.63 | 37.99 | |
| RearankModel Scale=7B, Reranker Type=Reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 38.35 | 50.91 | 59.73 | 14.06 | 19.34 | 37.49 | 34.29 | 26.27 | 35.06 | |
| Rank-R1Model Scale=7B, Reranker Type=Reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 34.04 | 51.63 | 50.96 | 12.79 | 21.96 | 34.79 | 31.7 | 25.08 | 32.87 | |
| Rank-KModel Scale=32B, Reranker Type=Reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 32.94 | 53.94 | 51.47 | 11.41 | 22.93 | 34.44 | 38.38 | 26.24 | 33.97 | |
| Rank1Model Scale=7B, Reranker Type=Reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 32.64 | 55.57 | 54.74 | 12.78 | 19.98 | 34.4 | 30.17 | 18.15 | 32.3 | |
| Rank1Model Scale=32B, Reranker Type=Reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 31.84 | 61.65 | 59.74 | 16.56 | 26.9 | 41.31 | 45.56 | 29.49 | 39.13 | |
| RankZephyrModel Scale=7B, Reranker Type=Non-reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 22.86 | 43.07 | 48.24 | 6.97 | 10.45 | 26.64 | 7.78 | 14.59 | 22.58 | |
| E5-mistralModel Scale=7B, Reranker Type=Retriever2025.08 | 18.28 | 41.47 | 41.01 | 6.44 | 11.38 | 19.81 | 30.97 | 21.37 | 23.84 | |
| RankT5Model Scale=3B, Reranker Type=Non-reasoning reranker, Retriever=E5-mistral, Rerank Top-k=1002025.08 | 13.2 | 32.84 | 23.38 | 2.09 | 4.18 | 0.61 | 14.55 | 12.39 | 12.91 |