# Boolean Question Answering on BoolQ-NP Source: [Boolean Question Answering on BoolQ-NP]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:28:52.496Z Evaluation of model performance on the BoolQ-NP dataset for Boolean Question Answering tasks, measured by Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Boolean Question Answering | | Dataset (including any stated split) | BoolQ-NP | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | OLTQA | 73.41 | Not recorded | 68fa6f471e209131cea44b64 | | OLTQA | 72.18 | Not recorded | 68fa6f471e209131cea44b64 | | OLTQA | 71.77 | Not recorded | 68fa6f471e209131cea44b64 | | OLTQA | 71.76 | Not recorded | 68fa6f471e209131cea44b64 | | OLTQA | 71.36 | Not recorded | 68fa6f471e209131cea44b64 | | OLTQA | 71.22 | Not recorded | 68fa6f471e209131cea44b64 | | OLTQA | 71.07 | Not recorded | 68fa6f471e209131cea44b64 | | OLTQA | 70.88 | Not recorded | 68fa6f471e209131cea44b64 | | OLTQA | 70.64 | Not recorded | 68fa6f471e209131cea44b64 | | ProQA | 69.67 | Not recorded | 68fa6f471e209131cea44b64 | | Muppet | 68.84 | Not recorded | 68fa6f471e209131cea44b64 | | UnifiedQA | 67.69 | Not recorded | 68fa6f471e209131cea44b64 | | Hyperformer++ | 67.66 | Not recorded | 68fa6f471e209131cea44b64 | | EPR | 59.43 | Not recorded | 68fa6f471e209131cea44b64 | ### OLTQA Accuracy: 73.41. Result ID: 6990b35f3a6c314849028db2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Configuration":"Full"}. This record does not assert independent reproduction. ### OLTQA Accuracy: 72.18. Result ID: 6990b35f3a6c314849028daf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Re-ranker":"excluded"}. This record does not assert independent reproduction. ### OLTQA Accuracy: 71.77. Result ID: 6990b35f3a6c314849028dac. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Knowledge Distillation":"without MKD"}. This record does not assert independent reproduction. ### OLTQA Accuracy: 71.76. Result ID: 6990b35f3a6c314849028daa. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Ablation":"without Pm"}. This record does not assert independent reproduction. ### OLTQA Accuracy: 71.36. Result ID: 6990b35f3a6c314849028db1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Knowledge Distillation":"Back KD"}. This record does not assert independent reproduction. ### OLTQA Accuracy: 71.22. Result ID: 6990b35f3a6c314849028dae. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever":"EPR"}. This record does not assert independent reproduction. ### OLTQA Accuracy: 71.07. Result ID: 6990b35f3a6c314849028dad. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Retriever":"BM25"}. This record does not assert independent reproduction. ### OLTQA Accuracy: 70.88. Result ID: 6990b35f3a6c314849028db0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Knowledge Distillation":"Static MKD"}. This record does not assert independent reproduction. ### OLTQA Accuracy: 70.64. Result ID: 6990b35f3a6c314849028dab. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Ablation":"without Pk"}. This record does not assert independent reproduction. ### ProQA Accuracy: 69.67. Result ID: 6990b35f3a6c314849028da6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Muppet Accuracy: 68.84. Result ID: 6990b35f3a6c314849028da7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### UnifiedQA Accuracy: 67.69. Result ID: 6990b35f3a6c314849028da5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Hyperformer++ Accuracy: 67.66. Result ID: 6990b35f3a6c314849028da8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### EPR Accuracy: 59.43. Result ID: 6990b35f3a6c314849028da9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.