Zero-shot Evaluation on Eight tasks zero-shot
60.31Accuracy (Zero-shot)Dense
Evaluation Results
| Method | Links | |
|---|---|---|
| DenseSparsity=0%, Pattern=-, Backbone Model=LLaMA-3.1 8B2025.09 | 60.31 | |
| DenseSparsity=0%, Pattern=-, Backbone Model=LLaMA-2 13B2025.09 | 58.38 | |
| PATCHTileSparsity=25%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-3.1 8B2025.09 | 56.48 | |
| PATCHTileSparsity=25%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 13B2025.09 | 56.31 | |
| PATCHTileSparsity=35%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-3.1 8B2025.09 | 55.28 | |
| DenseSparsity=0%, Pattern=-, Backbone Model=LLaMA-2 7B2025.09 | 54.61 | |
| PATCHTileSparsity=35%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 13B2025.09 | 54.6 | |
| PATCHTileSparsity=45%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-3.1 8B2025.09 | 53.6 | |
| PATCHTileSparsity=45%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 13B2025.09 | 53.24 | |
| MaskLLMSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.09 | 52.8 | |
| PATCHTileSparsity=25%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 7B2025.09 | 51.58 | |
| ProxSparseSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.09 | 50.8 | |
| PATCHTileSparsity=35%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 7B2025.09 | 50.08 | |
| SparseGPTSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.09 | 49.67 | |
| ThanosSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.09 | 49.33 | |
| PATCHTileSparsity=45%, Pattern=Dense/2:4 Tiles, Backbone Model=LLaMA-2 7B2025.09 | 48.99 | |
| MaskLLMSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.09 | 48.62 | |
| WandaSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.09 | 47.95 | |
| MagnitudeSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 13B2025.09 | 45.94 | |
| ProxSparseSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.09 | 45.92 | |
| ThanosSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.09 | 45.72 | |
| SparseGPTSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.09 | 45.53 | |
| ProxSparseSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.09 | 45.14 | |
| SparseGPTSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.09 | 45.09 | |
| ThanosSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.09 | 44.8 | |
| WandaSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.09 | 44.3 | |
| MagnitudeSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-2 7B2025.09 | 43.44 | |
| WandaSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.09 | 41.77 | |
| MagnitudeSparsity=50%, Pattern=2:4, Backbone Model=LLaMA-3.1 8B2025.09 | 35.93 |