# Zero-shot Prediction on BoolQ Source: [Zero-shot Prediction on BoolQ]() Collection index: [llms.txt]() Data updated: 2026-02-27T14:22:04.697Z Evaluation of model performance on the BoolQ dataset using zero-shot prediction methodology, typically measured by accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Zero-shot Prediction | | Dataset (including any stated split) | BoolQ | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Dense | 77.68 | Not recorded | 68fa7bd41e209131cea8ac27 | | SparseLLM | 75.14 | Not recorded | 68fa7bd41e209131cea8ac27 | | ALPS | 73.79 | Not recorded | 68fa7bd41e209131cea8ac27 | | Wanda | 72.87 | Not recorded | 68fa7bd41e209131cea8ac27 | | L-ADMM | 72.48 | Not recorded | 68fa7bd41e209131cea8ac27 | | SparseGPT | 71.77 | Not recorded | 68fa7bd41e209131cea8ac27 | | SparseLLM | 71.1 | Not recorded | 68fa7bd41e209131cea8ac27 | | ELSA | 69.42 | Not recorded | 68fa7bd41e209131cea8ac27 | | L-ADMM | 68.81 | Not recorded | 68fa7bd41e209131cea8ac27 | | ALPS | 68.75 | Not recorded | 68fa7bd41e209131cea8ac27 | | Wanda | 68.26 | Not recorded | 68fa7bd41e209131cea8ac27 | | SAFE | 68.04 | Not recorded | 68fa7bd41e209131cea8ac27 | | SparseGPT | 67.61 | Not recorded | 68fa7bd41e209131cea8ac27 | | SAFE | 66.42 | Not recorded | 68fa7bd41e209131cea8ac27 | | ELSA | 66.36 | Not recorded | 68fa7bd41e209131cea8ac27 | | Magnitude | 63.09 | Not recorded | 68fa7bd41e209131cea8ac27 | | Magnitude | 59.85 | Not recorded | 68fa7bd41e209131cea8ac27 | ### Dense Accuracy: 77.68. Result ID: 69a1a88b35dfcabb00e80766. [Reporting paper]() Recorded evaluation configuration: {"Sparsity":"0%","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SparseLLM Accuracy: 75.14. Result ID: 69a1a88b35dfcabb00e80775. [Reporting paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### ALPS Accuracy: 73.79. Result ID: 69a1a88b35dfcabb00e8076b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### Wanda Accuracy: 72.87. Result ID: 69a1a88b35dfcabb00e80770. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### L-ADMM Accuracy: 72.48. Result ID: 69a1a88b35dfcabb00e80772. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SparseGPT Accuracy: 71.77. Result ID: 69a1a88b35dfcabb00e80771. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SparseLLM Accuracy: 71.1. Result ID: 69a1a88b35dfcabb00e8076d. [Reporting paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### ELSA Accuracy: 69.42. Result ID: 69a1a88b35dfcabb00e80776. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### L-ADMM Accuracy: 68.81. Result ID: 69a1a88b35dfcabb00e8076a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### ALPS Accuracy: 68.75. Result ID: 69a1a88b35dfcabb00e80773. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### Wanda Accuracy: 68.26. Result ID: 69a1a88b35dfcabb00e80768. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SAFE Accuracy: 68.04. Result ID: 69a1a88b35dfcabb00e80774. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SparseGPT Accuracy: 67.61. Result ID: 69a1a88b35dfcabb00e80769. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SAFE Accuracy: 66.42. Result ID: 69a1a88b35dfcabb00e8076c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### ELSA Accuracy: 66.36. Result ID: 69a1a88b35dfcabb00e8076e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### Magnitude Accuracy: 63.09. Result ID: 69a1a88b35dfcabb00e8076f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### Magnitude Accuracy: 59.85. Result ID: 69a1a88b35dfcabb00e80767. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.