# Nugget Coverage Reranking on NeuCLIR ReportGen 2024 (test) Source: [Nugget Coverage Reranking on NeuCLIR ReportGen 2024 (test)]() Collection index: [llms.txt]() Data updated: 2026-05-28T10:10:36.638Z Evaluation of Nugget Coverage Reranking performance on the test split of the NeuCLIR ReportGen 2024 dataset, measured using nDCG, Precision, α-nDCG, and Coverage (Cov). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Nugget Coverage Reranking | | Dataset (including any stated split) | NeuCLIR ReportGen 2024 (test) | | Metric | nDCG | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [nDCG](): Higher is better; unit: PERCENT. - [Precision](): Higher is better; unit: PERCENT. - [Alpha-nDCG](): Higher is better; unit: PERCENT. - [Coverage](): Higher is better; unit: PERCENT. - [Precision@10](): Higher is better; unit: PERCENT. - [nDCG@10](): Higher is better; unit: PERCENT. - [Alpha-nDCG@10](): Higher is better; unit: PERCENT. - [Coverage@10](): Higher is better; unit: PERCENT. ## Recorded results | Method | nDCG | Result date | Report paper | | --- | --- | --- | --- | | LANCER | 92.9 | Not recorded | 697c3b75a8b01e76cc8da79c | | Listwise | 92.3 | Not recorded | 697c3b75a8b01e76cc8da79c | | Setwise | 91 | Not recorded | 697c3b75a8b01e76cc8da79c | | LANCER\_Q\* | 90.9 | Not recorded | 697c3b75a8b01e76cc8da79c | | Pointwise | 90.7 | Not recorded | 697c3b75a8b01e76cc8da79c | | Pointwise | 89.3 | Not recorded | 697c3b75a8b01e76cc8da79c | | Qwen3-Embed | 88.6 | Not recorded | 697c3b75a8b01e76cc8da79c | | LANCER\_Q\* | 88.6 | Not recorded | 697c3b75a8b01e76cc8da79c | | Listwise | 88.4 | Not recorded | 697c3b75a8b01e76cc8da79c | | LANCER\_Q\* | 88 | Not recorded | 697c3b75a8b01e76cc8da79c | | LANCER | 88 | Not recorded | 697c3b75a8b01e76cc8da79c | | LANCER | 86.2 | Not recorded | 697c3b75a8b01e76cc8da79c | | Listwise | 86 | Not recorded | 697c3b75a8b01e76cc8da79c | | Pointwise | 85.1 | Not recorded | 697c3b75a8b01e76cc8da79c | | Setwise | 84.6 | Not recorded | 697c3b75a8b01e76cc8da79c | | Setwise | 84.2 | Not recorded | 697c3b75a8b01e76cc8da79c | | LSR | 83.1 | Not recorded | 697c3b75a8b01e76cc8da79c | | BM25 | 67.7 | Not recorded | 697c3b75a8b01e76cc8da79c | ### LANCER nDCG: 92.9. Result ID: 6998a7ef5698665ec40a97e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"LSR","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Listwise nDCG: 92.3. Result ID: 6998a7ef5698665ec40a97e2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"LSR","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Setwise nDCG: 91. Result ID: 6998a7ef5698665ec40a97e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"LSR","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### LANCER\_Q\* nDCG: 90.9. Result ID: 6998a7ef5698665ec40a97e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"LSR","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Pointwise nDCG: 90.7. Result ID: 6998a7ef5698665ec40a97e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"LSR","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Pointwise nDCG: 89.3. Result ID: 6998a7ef5698665ec40a97db. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"BM25","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Qwen3-Embed nDCG: 88.6. Result ID: 6998a7ef5698665ec40a97e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"type":"First-stage retrieval"}. This record does not assert independent reproduction. ### LANCER\_Q\* nDCG: 88.6. Result ID: 6998a7ef5698665ec40a97eb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"Qwen3-Embed","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Listwise nDCG: 88.4. Result ID: 6998a7ef5698665ec40a97e8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"Qwen3-Embed","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### LANCER\_Q\* nDCG: 88. Result ID: 6998a7ef5698665ec40a97df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"BM25","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### LANCER nDCG: 88. Result ID: 6998a7ef5698665ec40a97ea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"Qwen3-Embed","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### LANCER nDCG: 86.2. Result ID: 6998a7ef5698665ec40a97de. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"BM25","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Listwise nDCG: 86. Result ID: 6998a7ef5698665ec40a97dc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"BM25","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Pointwise nDCG: 85.1. Result ID: 6998a7ef5698665ec40a97e7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"Qwen3-Embed","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Setwise nDCG: 84.6. Result ID: 6998a7ef5698665ec40a97e9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"Qwen3-Embed","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### Setwise nDCG: 84.2. Result ID: 6998a7ef5698665ec40a97dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"First-stage retrieval":"BM25","LLM Backbone":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### LSR nDCG: 83.1. Result ID: 6998a7ef5698665ec40a97e0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"type":"First-stage retrieval"}. This record does not assert independent reproduction. ### BM25 nDCG: 67.7. Result ID: 6998a7ef5698665ec40a97da. [Reporting paper]() Recorded evaluation configuration: {"type":"First-stage retrieval"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.