# Zero-shot Prediction on ARC-C Source: [Zero-shot Prediction on ARC-C]() Collection index: [llms.txt]() Data updated: 2026-02-27T14:22:04.608Z Evaluation of model performance on the ARC-C (Abstract Reasoning Corpus - Challenge Set) under a zero-shot prediction setting, measured by accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Zero-shot Prediction | | Dataset (including any stated split) | ARC-C | | Metric | Accuracy (Zero-shot) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy (Zero-shot)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy (Zero-shot) | Result date | Report paper | | --- | --- | --- | --- | | Dense | 43.35 | Not recorded | 68fa7bd41e209131cea8ac27 | | Magnitude | 36.01 | Not recorded | 68fa7bd41e209131cea8ac27 | | L-ADMM | 35.58 | Not recorded | 68fa7bd41e209131cea8ac27 | | SparseLLM | 34.9 | Not recorded | 68fa7bd41e209131cea8ac27 | | SparseGPT | 34.81 | Not recorded | 68fa7bd41e209131cea8ac27 | | ALPS | 34.47 | Not recorded | 68fa7bd41e209131cea8ac27 | | Wanda | 34.47 | Not recorded | 68fa7bd41e209131cea8ac27 | | ALPS | 33.28 | Not recorded | 68fa7bd41e209131cea8ac27 | | L-ADMM | 32.85 | Not recorded | 68fa7bd41e209131cea8ac27 | | ELSA | 32.25 | Not recorded | 68fa7bd41e209131cea8ac27 | | SAFE | 31.57 | Not recorded | 68fa7bd41e209131cea8ac27 | | ELSA | 31.49 | Not recorded | 68fa7bd41e209131cea8ac27 | | SparseGPT | 30.97 | Not recorded | 68fa7bd41e209131cea8ac27 | | SparseLLM | 30.55 | Not recorded | 68fa7bd41e209131cea8ac27 | | Wanda | 30.46 | Not recorded | 68fa7bd41e209131cea8ac27 | | SAFE | 30.46 | Not recorded | 68fa7bd41e209131cea8ac27 | | Magnitude | 30.12 | Not recorded | 68fa7bd41e209131cea8ac27 | ### Dense Accuracy (Zero-shot): 43.35. Result ID: 69a1a88b35dfcabb00e80744. [Reporting paper]() Recorded evaluation configuration: {"Sparsity":"0%","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### Magnitude Accuracy (Zero-shot): 36.01. Result ID: 69a1a88b35dfcabb00e8074d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### L-ADMM Accuracy (Zero-shot): 35.58. Result ID: 69a1a88b35dfcabb00e80750. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SparseLLM Accuracy (Zero-shot): 34.9. Result ID: 69a1a88b35dfcabb00e80753. [Reporting paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SparseGPT Accuracy (Zero-shot): 34.81. Result ID: 69a1a88b35dfcabb00e8074f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### ALPS Accuracy (Zero-shot): 34.47. Result ID: 69a1a88b35dfcabb00e80749. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### Wanda Accuracy (Zero-shot): 34.47. Result ID: 69a1a88b35dfcabb00e8074e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### ALPS Accuracy (Zero-shot): 33.28. Result ID: 69a1a88b35dfcabb00e80751. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### L-ADMM Accuracy (Zero-shot): 32.85. Result ID: 69a1a88b35dfcabb00e80748. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### ELSA Accuracy (Zero-shot): 32.25. Result ID: 69a1a88b35dfcabb00e80754. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SAFE Accuracy (Zero-shot): 31.57. Result ID: 69a1a88b35dfcabb00e80752. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"4:8","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### ELSA Accuracy (Zero-shot): 31.49. Result ID: 69a1a88b35dfcabb00e8074c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SparseGPT Accuracy (Zero-shot): 30.97. Result ID: 69a1a88b35dfcabb00e80747. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SparseLLM Accuracy (Zero-shot): 30.55. Result ID: 69a1a88b35dfcabb00e8074b. [Reporting paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### Wanda Accuracy (Zero-shot): 30.46. Result ID: 69a1a88b35dfcabb00e80746. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### SAFE Accuracy (Zero-shot): 30.46. Result ID: 69a1a88b35dfcabb00e8074a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. ### Magnitude Accuracy (Zero-shot): 30.12. Result ID: 69a1a88b35dfcabb00e80745. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Sparsity":"2:4","Backbone":"LLaMA-2-7B","Zero-shot":"true"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.