Question Answering on OBQA (Zero-shot)
35.2Zero-shot AccuracyDense
Evaluation Results
| Method | Links | |
|---|---|---|
| DenseSparsity=0%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 35.2 | |
| ELSASparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 33.8 | |
| ALPSSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 32.6 | |
| L-ADMMSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 32 | |
| WandaSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 31.2 | |
| SparseGPTSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 31 | |
| ELSASparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 31 | |
| ALPSSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 30.8 | |
| SAFESparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 30.6 | |
| L-ADMMSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 29.8 | |
| SAFESparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 28.8 | |
| WandaSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 28.2 | |
| MagnitudeSparsity=50%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 27.8 | |
| SparseGPTSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 27.4 | |
| ALPSSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 26.6 | |
| ELSASparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 24.8 | |
| L-ADMMSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 24 | |
| MagnitudeSparsity=60%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 21.8 | |
| SparseGPTSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 20.2 | |
| SAFESparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 20.2 | |
| ELSASparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 19.6 | |
| ELSASparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 16.2 | |
| MagnitudeSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 15 | |
| MagnitudeSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 14.8 | |
| MagnitudeSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 14.6 | |
| L-ADMMSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 14.6 | |
| SAFESparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 14.2 | |
| ALPSSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 14 | |
| WandaSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 13.8 | |
| SparseGPTSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 13.8 | |
| L-ADMMSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 13.8 | |
| ALPSSparsity=90%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 13.4 | |
| WandaSparsity=70%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 13 | |
| SparseGPTSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 12.8 | |
| SAFESparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 12.8 | |
| WandaSparsity=80%, Backbone=Llama-2 13B, Protocol=Zero-shot2025.10 | 12.6 |