Zero-shot Prediction on OBQA
31.4AccuracyDense
Evaluation Results
| Method | Links | |
|---|---|---|
| DenseSparsity=0%, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 31.4 | |
| L-ADMMSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 28.8 | |
| SparseGPTSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 27.8 | |
| ALPSSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 27.6 | |
| ELSASparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 27.4 | |
| WandaSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 26.8 | |
| ALPSSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 26.2 | |
| SparseLLMSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 26.2 | |
| MagnitudeSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 26 | |
| L-ADMMSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 25.4 | |
| SparseLLMSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 24.4 | |
| WandaSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 24.2 | |
| SparseGPTSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 24.2 | |
| ELSASparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 23.6 | |
| SAFESparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 23.4 | |
| MagnitudeSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 21.8 | |
| SAFESparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 21.6 |