Reranking on R2MED (test)
52.3Average ScoreGroupRank
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| GroupRankParadigm=Groupwise, Parameters=32B, Rerank depth=top-100, Query type=original2025.11 | 52.3 | 59.5 | 69.7 | 66.3 | 28.8 | 41.5 | 67.6 | 52.2 | 32.7 | |
| ReasonRankParadigm=Listwise, Parameters=32B, Rerank depth=top-100, Query type=original2025.11 | 50.2 | 53.9 | 68.9 | 68.4 | 28.2 | 40.3 | 67.4 | 45.1 | 29.1 | |
| Rank-KParadigm=Listwise, Parameters=32B, Rerank depth=top-100, Query type=original2025.11 | 49.5 | 58.9 | 67.8 | 58.9 | 30.3 | 40.5 | 65.3 | 42.5 | 31.5 | |
| ERankParadigm=Pointwise, Parameters=32B, Rerank depth=top-100, Query type=original2025.11 | 49.3 | 54 | 69.5 | 62.2 | 25 | 31.9 | 65.9 | 51.2 | 35 | |
| Rank-R1Paradigm=Listwise, Parameters=14B, Rerank depth=top-100, Query type=original2025.11 | 49.3 | 59 | 63.2 | 61.9 | 27.7 | 40.4 | 66.3 | 43.2 | 32.7 | |
| Rank-R1Paradigm=Listwise, Parameters=7B, Rerank depth=top-100, Query type=original2025.11 | 47.8 | 58.2 | 65.8 | 56.7 | 29.9 | 40.6 | 66.1 | 35.1 | 29.8 | |
| GroupRankParadigm=Groupwise, Parameters=7B, Rerank depth=top-100, Query type=original2025.11 | 47.8 | 56.7 | 65.4 | 64.2 | 27.3 | 30.5 | 64.6 | 43.2 | 30.9 | |
| Diver-RetrieverParadigm=Retriever, Parameters=4B, Rerank depth=top-100, Query type=original2025.11 | 42.9 | 49.3 | 60.4 | 57.9 | 18.6 | 22.6 | 58.7 | 44.1 | 31.8 | |
| ReasonRankParadigm=Listwise, Parameters=7B, Rerank depth=top-100, Query type=original2025.11 | 42.8 | 48.9 | 61.6 | 61.7 | 20.5 | 32.4 | 59.1 | 36.9 | 21.5 | |
| ERankParadigm=Pointwise, Parameters=4B, Rerank depth=top-100, Query type=original2025.11 | 41.8 | 47.9 | 63 | 62.3 | 21.7 | 28.7 | 41.4 | 46.5 | 22.7 | |
| RankZephyrParadigm=Listwise, Parameters=7B, Rerank depth=top-100, Query type=original2025.11 | 37.5 | 48.8 | 55.7 | 54.9 | 26.7 | 26.1 | 57.8 | 10.9 | 18.7 | |
| RankT5Paradigm=Pointwise, Parameters=3B, Rerank depth=top-100, Query type=original2025.11 | 28.4 | 39.8 | 46.3 | 31.7 | 21.6 | 19.9 | 31.4 | 17.8 | 18.4 |