Zero-shot Classification on Eight Downstream Tasks Zero-Shot
47.7Accuracy (Zero-shot)Dense
Evaluation Results
| Method | Links | |
|---|---|---|
| DenseSparsity=0%, Pattern=-, Model=LLaMA-3.2 1B2025.09 | 47.7 | |
| DenseSparsity=0%, Pattern=-, Model=Gemma-3 1B2025.09 | 47.01 | |
| DenseSparsity=0%, Pattern=-, Model=Qwen-2.5 0.5B2025.09 | 46 | |
| PATCHJointSparsity=25%, Pattern=Dense/2:4 Tiles, Model=Gemma-3 1B2025.09 | 44.07 | |
| PATCHJointSparsity=25%, Pattern=Dense/2:4 Tiles, Model=LLaMA-3.2 1B2025.09 | 43.81 | |
| PATCHJointSparsity=35%, Pattern=Dense/2:4 Tiles, Model=Gemma-3 1B2025.09 | 43.3 | |
| PATCHJointSparsity=45%, Pattern=Dense/2:4 Tiles, Model=Gemma-3 1B2025.09 | 42.8 | |
| PATCHJointSparsity=35%, Pattern=Dense/2:4 Tiles, Model=LLaMA-3.2 1B2025.09 | 42.72 | |
| PATCHJointSparsity=25%, Pattern=Dense/2:4 Tiles, Model=Qwen-2.5 0.5B2025.09 | 42.39 | |
| PATCHJointSparsity=45%, Pattern=Dense/2:4 Tiles, Model=LLaMA-3.2 1B2025.09 | 42.08 | |
| MaskLLMSparsity=50%, Pattern=2:4, Model=Gemma-3 1B2025.09 | 41.84 | |
| PATCHJointSparsity=35%, Pattern=Dense/2:4 Tiles, Model=Qwen-2.5 0.5B2025.09 | 41.15 | |
| MaskLLMSparsity=50%, Pattern=2:4, Model=LLaMA-3.2 1B2025.09 | 41.04 | |
| PATCHJointSparsity=45%, Pattern=Dense/2:4 Tiles, Model=Qwen-2.5 0.5B2025.09 | 40.29 | |
| MaskLLMSparsity=50%, Pattern=2:4, Model=Qwen-2.5 0.5B2025.09 | 39.33 | |
| ProxSparseSparsity=50%, Pattern=2:4, Model=Gemma-3 1B2025.09 | 36.63 | |
| ThanosSparsity=50%, Pattern=2:4, Model=LLaMA-3.2 1B2025.09 | 35.71 | |
| SparseGPTSparsity=50%, Pattern=2:4, Model=Gemma-3 1B2025.09 | 35.58 | |
| SparseGPTSparsity=50%, Pattern=2:4, Model=LLaMA-3.2 1B2025.09 | 35.55 | |
| ThanosSparsity=50%, Pattern=2:4, Model=Gemma-3 1B2025.09 | 35.09 | |
| SparseGPTSparsity=50%, Pattern=2:4, Model=Qwen-2.5 0.5B2025.09 | 34.81 | |
| WandaSparsity=50%, Pattern=2:4, Model=Gemma-3 1B2025.09 | 34.16 | |
| ProxSparseSparsity=50%, Pattern=2:4, Model=LLaMA-3.2 1B2025.09 | 33.55 | |
| WandaSparsity=50%, Pattern=2:4, Model=Qwen-2.5 0.5B2025.09 | 32.97 | |
| ProxSparseSparsity=50%, Pattern=2:4, Model=Qwen-2.5 0.5B2025.09 | 32.05 | |
| MagnitudeSparsity=50%, Pattern=2:4, Model=Gemma-3 1B2025.09 | 31.66 | |
| WandaSparsity=50%, Pattern=2:4, Model=LLaMA-3.2 1B2025.09 | 31.61 | |
| ThanosSparsity=50%, Pattern=2:4, Model=Qwen-2.5 0.5B2025.09 | 31.31 | |
| MagnitudeSparsity=50%, Pattern=2:4, Model=Qwen-2.5 0.5B2025.09 | 30.16 | |
| MagnitudeSparsity=50%, Pattern=2:4, Model=LLaMA-3.2 1B2025.09 | 29.66 |