Zero-shot Question Answering on ARC-E
79.38Zero-shot AccuracyDense
Evaluation Results
| Method | Links | |
|---|---|---|
| DenseSparsity=0%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 79.38 | |
| WandaSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 76.3 | |
| ALPSSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 76.3 | |
| L-ADMMSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 75.84 | |
| SAFESparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 75.84 | |
| ELSASparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 75.12 | |
| SparseGPTSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 74.96 | |
| L-ADMMSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 72.98 | |
| ALPSSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 72.93 | |
| SAFESparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 72.43 | |
| ELSASparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 70.67 | |
| MagnitudeSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 70.58 | |
| SparseGPTSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 69.4 | |
| WandaSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 68.81 | |
| ELSASparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 62.42 | |
| ALPSSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 61.2 | |
| SAFESparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 61.07 | |
| L-ADMMSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 59.64 | |
| MagnitudeSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 56.14 | |
| ELSASparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 50.97 | |
| SparseGPTSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 49.58 | |
| WandaSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 36.45 | |
| ELSASparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 36.15 | |
| ALPSSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 35.99 | |
| L-ADMMSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 33.8 | |
| MagnitudeSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 31.31 | |
| SparseGPTSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 28.79 | |
| SAFESparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 28.37 | |
| ALPSSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 26.94 | |
| WandaSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 26.26 | |
| L-ADMMSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 26.01 | |
| WandaSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 25.93 | |
| SparseGPTSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 25.76 | |
| SAFESparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 25.76 | |
| MagnitudeSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 25.63 | |
| MagnitudeSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 24.87 |