# Open-Book Question Answering on NQ-Open Open-Book (Exact Match) Source: [Open-Book Question Answering on NQ-Open Open-Book (Exact Match)]() Collection index: [llms.txt]() Data updated: 2026-06-04T07:28:39.862Z Evaluation of model performance on the NQ-Open Open-Book dataset for Open-Book Question Answering, measured using Exact Match. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Open-Book Question Answering | | Dataset (including any stated split) | NQ-Open Open-Book | | Metric | Exact Match | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Exact Match](): Higher is better; unit: PERCENT. ## Recorded results | Method | Exact Match | Result date | Report paper | | --- | --- | --- | --- | | DCO | 79.51 | Not recorded | 6a210686c10484bac23f010c | | DCO | 74.95 | Not recorded | 6a210686c10484bac23f010c | | DeCoRe (static) | 72.51 | Not recorded | 6a210686c10484bac23f010c | | ITI | 71.9 | Not recorded | 6a210686c10484bac23f010c | | CAD | 71.83 | Not recorded | 6a210686c10484bac23f010c | | AD | 71.15 | Not recorded | 6a210686c10484bac23f010c | | Greedy | 71.07 | Not recorded | 6a210686c10484bac23f010c | | DoLa (low) | 71.07 | Not recorded | 6a210686c10484bac23f010c | | DeCoRe (static) | 70.62 | Not recorded | 6a210686c10484bac23f010c | | DoLa (high) | 70.4 | Not recorded | 6a210686c10484bac23f010c | | CAD | 69.83 | Not recorded | 6a210686c10484bac23f010c | | Greedy | 69.68 | Not recorded | 6a210686c10484bac23f010c | | DoLa (low) | 69.68 | Not recorded | 6a210686c10484bac23f010c | | DoLa (high) | 69.49 | Not recorded | 6a210686c10484bac23f010c | | AD | 68.93 | Not recorded | 6a210686c10484bac23f010c | | CD | 65.8 | Not recorded | 6a210686c10484bac23f010c | | ITI | 56.16 | Not recorded | 6a210686c10484bac23f010c | ### DCO Exact Match: 79.51. Result ID: 6a212925fbc373592c1c5165. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-70B"}. This record does not assert independent reproduction. ### DCO Exact Match: 74.95. Result ID: 6a212925fbc373592c1c515c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-8B"}. This record does not assert independent reproduction. ### DeCoRe (static) Exact Match: 72.51. Result ID: 6a212925fbc373592c1c5164. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-70B"}. This record does not assert independent reproduction. ### ITI Exact Match: 71.9. Result ID: 6a212925fbc373592c1c515e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-70B"}. This record does not assert independent reproduction. ### CAD Exact Match: 71.83. Result ID: 6a212925fbc373592c1c5160. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-70B"}. This record does not assert independent reproduction. ### AD Exact Match: 71.15. Result ID: 6a212925fbc373592c1c5163. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Llama-3-70B"}. This record does not assert independent reproduction. ### Greedy Exact Match: 71.07. Result ID: 6a212925fbc373592c1c515d. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3-70B"}. This record does not assert independent reproduction. ### DoLa (low) Exact Match: 71.07. Result ID: 6a212925fbc373592c1c5161. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-70B"}. This record does not assert independent reproduction. ### DeCoRe (static) Exact Match: 70.62. Result ID: 6a212925fbc373592c1c515b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-8B"}. This record does not assert independent reproduction. ### DoLa (high) Exact Match: 70.4. Result ID: 6a212925fbc373592c1c5162. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-70B"}. This record does not assert independent reproduction. ### CAD Exact Match: 69.83. Result ID: 6a212925fbc373592c1c5157. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-8B"}. This record does not assert independent reproduction. ### Greedy Exact Match: 69.68. Result ID: 6a212925fbc373592c1c5155. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3-8B"}. This record does not assert independent reproduction. ### DoLa (low) Exact Match: 69.68. Result ID: 6a212925fbc373592c1c5158. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-8B"}. This record does not assert independent reproduction. ### DoLa (high) Exact Match: 69.49. Result ID: 6a212925fbc373592c1c5159. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-8B"}. This record does not assert independent reproduction. ### AD Exact Match: 68.93. Result ID: 6a212925fbc373592c1c515a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Llama-3-8B"}. This record does not assert independent reproduction. ### CD Exact Match: 65.8. Result ID: 6a212925fbc373592c1c515f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Llama-3-70B"}. This record does not assert independent reproduction. ### ITI Exact Match: 56.16. Result ID: 6a212925fbc373592c1c5156. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-8B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.