Question Answering on ARC Challenge (Zero-shot)
48.46Zero-shot AccuracyDense
Evaluation Results
| Method | Links | |
|---|---|---|
| DenseSparsity=0%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 48.46 | |
| ELSASparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 43.68 | |
| L-ADMMSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 43.17 | |
| WandaSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 43.09 | |
| ALPSSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 42.66 | |
| SparseGPTSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 42.41 | |
| SAFESparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 41.64 | |
| ELSASparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 40.53 | |
| ALPSSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 40.44 | |
| L-ADMMSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 39.76 | |
| MagnitudeSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 38.48 | |
| WandaSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 37.97 | |
| SAFESparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 36.95 | |
| SparseGPTSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 36.01 | |
| ELSASparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 34.13 | |
| SAFESparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 29.78 | |
| ALPSSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 29.61 | |
| L-ADMMSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 27.56 | |
| MagnitudeSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 27.13 | |
| SparseGPTSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 25.34 | |
| ELSASparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 24.32 | |
| SAFESparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 22.1 | |
| MagnitudeSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 21.84 | |
| MagnitudeSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 21.42 | |
| WandaSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 21.33 | |
| SparseGPTSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 21.08 | |
| MagnitudeSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 20.65 | |
| WandaSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 20.48 | |
| ALPSSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 20.05 | |
| L-ADMMSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 19.88 | |
| SparseGPTSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 19.62 | |
| L-ADMMSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 19.11 | |
| ELSASparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 19.03 | |
| ALPSSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 18.94 | |
| WandaSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 18.43 | |
| SAFESparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 18.34 |