# Passage Reranking on NQ BEIR Source: [Passage Reranking on NQ BEIR]() Collection index: [llms.txt]() Data updated: 2026-04-21T09:59:20.548Z Evaluation of Passage Reranking performance specifically on the Natural Questions (NQ) component within the BEIR benchmark suite, reporting NDCG@10 and Success Rate (SR). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Passage Reranking | | Dataset (including any stated split) | NQ BEIR | | Metric | NDCG@10 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 19 of 19 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [NDCG@10](): Higher is better; unit: PERCENT. - [Success Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | NDCG@10 | Result date | Report paper | | --- | --- | --- | --- | | HeadRank | 45.36 | Not recorded | 69e704cc7d0172140ec7efac | | RankGPT | 44.86 | Not recorded | 69e704cc7d0172140ec7efac | | QR-R | 44.3 | Not recorded | 69e704cc7d0172140ec7efac | | HeadRank | 43.32 | Not recorded | 69e704cc7d0172140ec7efac | | HeadRank | 43.25 | Not recorded | 69e704cc7d0172140ec7efac | | CoRe | 42.8 | Not recorded | 69e704cc7d0172140ec7efac | | CoRe | 40 | Not recorded | 69e704cc7d0172140ec7efac | | QR-R | 40 | Not recorded | 69e704cc7d0172140ec7efac | | RankGPT | 39.5 | Not recorded | 69e704cc7d0172140ec7efac | | ICR | 37.67 | Not recorded | 69e704cc7d0172140ec7efac | | ICR | 37.09 | Not recorded | 69e704cc7d0172140ec7efac | | CoRe | 36.61 | Not recorded | 69e704cc7d0172140ec7efac | | NIAH | 35.98 | Not recorded | 69e704cc7d0172140ec7efac | | QR-R | 35.45 | Not recorded | 69e704cc7d0172140ec7efac | | NIAH | 34.4 | Not recorded | 69e704cc7d0172140ec7efac | | NIAH | 33.83 | Not recorded | 69e704cc7d0172140ec7efac | | ICR | 33.62 | Not recorded | 69e704cc7d0172140ec7efac | | RankGPT | 30.89 | Not recorded | 69e704cc7d0172140ec7efac | | BM25 (top40) | 30.55 | Not recorded | 69e704cc7d0172140ec7efac | ### HeadRank NDCG@10: 45.36. Result ID: 69e74a6947f34ce924ce06f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### RankGPT NDCG@10: 44.86. Result ID: 69e74a6947f34ce924ce06ed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### QR-R NDCG@10: 44.3. Result ID: 69e74a6947f34ce924ce06f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### HeadRank NDCG@10: 43.32. Result ID: 69e74a6947f34ce924ce06ec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### HeadRank NDCG@10: 43.25. Result ID: 69e74a6947f34ce924ce06e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### CoRe NDCG@10: 42.8. Result ID: 69e74a6947f34ce924ce06ef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### CoRe NDCG@10: 40. Result ID: 69e74a6947f34ce924ce06e9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### QR-R NDCG@10: 40. Result ID: 69e74a6947f34ce924ce06ea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### RankGPT NDCG@10: 39.5. Result ID: 69e74a6947f34ce924ce06e7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### ICR NDCG@10: 37.67. Result ID: 69e74a6947f34ce924ce06ee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### ICR NDCG@10: 37.09. Result ID: 69e74a6947f34ce924ce06e8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### CoRe NDCG@10: 36.61. Result ID: 69e74a6947f34ce924ce06e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### NIAH NDCG@10: 35.98. Result ID: 69e74a6947f34ce924ce06eb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-1.7B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### QR-R NDCG@10: 35.45. Result ID: 69e74a6947f34ce924ce06e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### NIAH NDCG@10: 34.4. Result ID: 69e74a6947f34ce924ce06f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-4B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### NIAH NDCG@10: 33.83. Result ID: 69e74a6947f34ce924ce06e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### ICR NDCG@10: 33.62. Result ID: 69e74a6947f34ce924ce06e2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### RankGPT NDCG@10: 30.89. Result ID: 69e74a6947f34ce924ce06e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-0.6B","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. ### BM25 (top40) NDCG@10: 30.55. Result ID: 69e74a6947f34ce924ce06e0. [Reporting paper]() Recorded evaluation configuration: {"Model":"Baseline","Top-40 retrieval setting":"BM25"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.