Zero-shot Evaluation on ARC-C, ARC-E, BoolQ, HellaSwag, PIQA, RTE, and WinoGrande
72.9AccuracyDense
Evaluation Results
| Method | Links | |
|---|---|---|
| DenseSparsity(CR)=0%, Backbone=Llama-3 8B2026.04 | 72.9 | |
| SLaBSparsity(CR)=US (50%), Backbone=Llama-3 8B2026.04 | 70.7 | |
| SLaBSparsity(CR)=4:8 (50%), Backbone=Llama-3 8B2026.04 | 70.1 | |
| SLaBSparsity(CR)=2:4 (50%), Backbone=Llama-3 8B2026.04 | 70.1 | |
| SLaBSparsity(CR)=US (60%), Backbone=Llama-3 8B2026.04 | 69.2 | |
| DenseSparsity(CR)=0%, Backbone=Llama-2 7B2026.04 | 68.4 | |
| SparseGPTSparsity(CR)=US (50%), Backbone=Llama-3 8B2026.04 | 66.9 | |
| SLaBSparsity(CR)=US (50%), Backbone=Llama-2 7B2026.04 | 66.2 | |
| WandaSparsity(CR)=US (50%), Backbone=Llama-3 8B2026.04 | 65.4 | |
| WandaSparsity(CR)=4:8 (50%), Backbone=Llama-3 8B2026.04 | 65.4 | |
| SLaBSparsity(CR)=4:8 (50%), Backbone=Llama-2 7B2026.04 | 65.3 | |
| SLaBSparsity(CR)=2:4 (50%), Backbone=Llama-2 7B2026.04 | 65.3 | |
| SLaBSparsity(CR)=US (60%), Backbone=Llama-2 7B2026.04 | 65 | |
| SLaBSparsity(CR)=US (70%), Backbone=Llama-3 8B2026.04 | 64.3 | |
| WandaSparsity(CR)=US (50%), Backbone=Llama-2 7B2026.04 | 64 | |
| SparseGPTSparsity(CR)=US (50%), Backbone=Llama-2 7B2026.04 | 63.9 | |
| SLaBSparsity(CR)=US (70%), Backbone=Llama-2 7B2026.04 | 62.2 | |
| SparseGPTSparsity(CR)=4:8 (50%), Backbone=Llama-2 7B2026.04 | 61.6 | |
| SparseGPTSparsity(CR)=4:8 (50%), Backbone=Llama-3 8B2026.04 | 61.3 | |
| WandaSparsity(CR)=4:8 (50%), Backbone=Llama-2 7B2026.04 | 60.8 | |
| SparseGPTSparsity(CR)=US (60%), Backbone=Llama-3 8B2026.04 | 59 | |
| SparseGPTSparsity(CR)=2:4 (50%), Backbone=Llama-2 7B2026.04 | 58.9 | |
| SparseGPTSparsity(CR)=US (60%), Backbone=Llama-2 7B2026.04 | 58.7 | |
| DenseSparsity(CR)=0%, Backbone=Llama-3.2 1B2026.04 | 58.3 | |
| SparseGPTSparsity(CR)=2:4 (50%), Backbone=Llama-3 8B2026.04 | 57.4 | |
| WandaSparsity(CR)=US (60%), Backbone=Llama-2 7B2026.04 | 57.1 | |
| SLaBSparsity(CR)=US (50%), Backbone=Llama-3.2 1B2026.04 | 55.8 | |
| WandaSparsity(CR)=2:4 (50%), Backbone=Llama-2 7B2026.04 | 55.6 | |
| SLaBSparsity(CR)=US (80%), Backbone=Llama-2 7B2026.04 | 53.4 | |
| WandaSparsity(CR)=US (60%), Backbone=Llama-3 8B2026.04 | 53.3 | |
| SLaBSparsity(CR)=4:8 (50%), Backbone=Llama-3.2 1B2026.04 | 52.5 | |
| SLaBSparsity(CR)=2:4 (50%), Backbone=Llama-3.2 1B2026.04 | 52.5 | |
| WandaSparsity(CR)=2:4 (50%), Backbone=Llama-3 8B2026.04 | 52.2 | |
| SLaBSparsity(CR)=US (60%), Backbone=Llama-3.2 1B2026.04 | 51.7 | |
| SparseGPTSparsity(CR)=US (50%), Backbone=Llama-3.2 1B2026.04 | 51.2 | |
| SLaBSparsity(CR)=US (80%), Backbone=Llama-3 8B2026.04 | 49.3 | |
| WandaSparsity(CR)=US (50%), Backbone=Llama-3.2 1B2026.04 | 48.5 | |
| SparseGPTSparsity(CR)=4:8 (50%), Backbone=Llama-3.2 1B2026.04 | 48 | |
| SparseGPTSparsity(CR)=US (70%), Backbone=Llama-2 7B2026.04 | 47.6 | |
| SparseGPTSparsity(CR)=US (70%), Backbone=Llama-3 8B2026.04 | 46.9 | |
| SLaBSparsity(CR)=US (70%), Backbone=Llama-3.2 1B2026.04 | 46.6 | |
| SparseGPTSparsity(CR)=2:4 (50%), Backbone=Llama-3.2 1B2026.04 | 46.5 | |
| SparseGPTSparsity(CR)=US (60%), Backbone=Llama-3.2 1B2026.04 | 45.2 | |
| WandaSparsity(CR)=4:8 (50%), Backbone=Llama-3.2 1B2026.04 | 44.3 | |
| WandaSparsity(CR)=US (60%), Backbone=Llama-3.2 1B2026.04 | 41.5 | |
| SLaBSparsity(CR)=US (80%), Backbone=Llama-3.2 1B2026.04 | 41.5 | |
| WandaSparsity(CR)=2:4 (50%), Backbone=Llama-3.2 1B2026.04 | 41.3 | |
| SparseGPTSparsity(CR)=US (70%), Backbone=Llama-3.2 1B2026.04 | 40.8 | |
| WandaSparsity(CR)=US (70%), Backbone=Llama-2 7B2026.04 | 39.9 | |
| SparseGPTSparsity(CR)=US (80%), Backbone=Llama-3 8B2026.04 | 39.5 | |
| WandaSparsity(CR)=US (70%), Backbone=Llama-3 8B2026.04 | 39.3 | |
| SparseGPTSparsity(CR)=US (80%), Backbone=Llama-3.2 1B2026.04 | 38.5 | |
| SparseGPTSparsity(CR)=US (80%), Backbone=Llama-2 7B2026.04 | 37.6 | |
| WandaSparsity(CR)=US (70%), Backbone=Llama-3.2 1B2026.04 | 37.4 | |
| WandaSparsity(CR)=US (80%), Backbone=Llama-3 8B2026.04 | 37.2 | |
| WandaSparsity(CR)=US (80%), Backbone=Llama-3.2 1B2026.04 | 36.6 | |
| WandaSparsity(CR)=US (80%), Backbone=Llama-2 7B2026.04 | 36.1 |