# Passage Reranking on SciDocs BEIR Source: [Passage Reranking on SciDocs BEIR]() Collection index: [llms.txt]() Data updated: 2026-04-21T09:59:20.461Z Evaluation of Passage Reranking performance on the SciDocs BEIR dataset, reporting metrics such as NDCG@10 and Success Rate (SR). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Passage Reranking | | Dataset (including any stated split) | SciDocs BEIR | | Metric | NDCG@10 | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 19 of 19 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [NDCG@10](): Higher is better; unit: SCALAR. - [Success Rate (%)](): Higher is better; unit: PERCENT. ## Recorded results | Method | NDCG@10 | Result date | Report paper | | --- | --- | --- | --- | | HeadRank | 16.96 | Not recorded | 69e704cc7d0172140ec7efac | | HeadRank | 16.89 | Not recorded | 69e704cc7d0172140ec7efac | | RankGPT | 16.68 | Not recorded | 69e704cc7d0172140ec7efac | | CoRe | 16.57 | Not recorded | 69e704cc7d0172140ec7efac | | CoRe | 16.52 | Not recorded | 69e704cc7d0172140ec7efac | | RankGPT | 16.46 | Not recorded | 69e704cc7d0172140ec7efac | | HeadRank | 16.36 | Not recorded | 69e704cc7d0172140ec7efac | | QR-R | 16 | Not recorded | 69e704cc7d0172140ec7efac | | QR-R | 15.98 | Not recorded | 69e704cc7d0172140ec7efac | | ICR | 15.59 | Not recorded | 69e704cc7d0172140ec7efac | | CoRe | 15.48 | Not recorded | 69e704cc7d0172140ec7efac | | NIAH | 15.44 | Not recorded | 69e704cc7d0172140ec7efac | | BM25 (top40) | 14.9 | Not recorded | 69e704cc7d0172140ec7efac | | NIAH | 14.69 | Not recorded | 69e704cc7d0172140ec7efac | | RankGPT | 14.6 | Not recorded | 69e704cc7d0172140ec7efac | | NIAH | 14.58 | Not recorded | 69e704cc7d0172140ec7efac | | ICR | 14.47 | Not recorded | 69e704cc7d0172140ec7efac | | QR-R | 13.93 | Not recorded | 69e704cc7d0172140ec7efac | | ICR | 13.75 | Not recorded | 69e704cc7d0172140ec7efac | ### HeadRank NDCG@10: 16.96. Result ID: 69e74a6947f34ce924ce06c6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### HeadRank NDCG@10: 16.89. Result ID: 69e74a6947f34ce924ce06cc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### RankGPT NDCG@10: 16.68. Result ID: 69e74a6947f34ce924ce06c7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### CoRe NDCG@10: 16.57. Result ID: 69e74a6947f34ce924ce06c3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### CoRe NDCG@10: 16.52. Result ID: 69e74a6947f34ce924ce06c9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### RankGPT NDCG@10: 16.46. Result ID: 69e74a6947f34ce924ce06c1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### HeadRank NDCG@10: 16.36. Result ID: 69e74a6947f34ce924ce06c0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### QR-R NDCG@10: 16. Result ID: 69e74a6947f34ce924ce06c4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### QR-R NDCG@10: 15.98. Result ID: 69e74a6947f34ce924ce06ca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### ICR NDCG@10: 15.59. Result ID: 69e74a6947f34ce924ce06c2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### CoRe NDCG@10: 15.48. Result ID: 69e74a6947f34ce924ce06bd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### NIAH NDCG@10: 15.44. Result ID: 69e74a6947f34ce924ce06c5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### BM25 (top40) NDCG@10: 14.9. Result ID: 69e74a6947f34ce924ce06ba. [Reporting paper]() Recorded evaluation configuration: {"Model":"Baseline","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### NIAH NDCG@10: 14.69. Result ID: 69e74a6947f34ce924ce06cb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### RankGPT NDCG@10: 14.6. Result ID: 69e74a6947f34ce924ce06bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### NIAH NDCG@10: 14.58. Result ID: 69e74a6947f34ce924ce06bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### ICR NDCG@10: 14.47. Result ID: 69e74a6947f34ce924ce06c8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### QR-R NDCG@10: 13.93. Result ID: 69e74a6947f34ce924ce06be. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### ICR NDCG@10: 13.75. Result ID: 69e74a6947f34ce924ce06bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.