Zero-shot Accuracy on ARC Easy
78.2Zero-shot Acc (ARC Easy)QTIP
Evaluation Results
| Method | Links | |
|---|---|---|
| QTIPModel Size=2-70, Bits=32024.06 | 78.2 | |
| AQLMModel Size=2-70, Bits=3.012024.06 | 78 | |
| QTIPModel Size=2-70, Bits=42024.06 | 77.8 | |
| FP16Model Size=2-70, Bits=162024.06 | 77.7 | |
| QUIP#Model Size=2-70, Bits=42024.06 | 77.7 | |
| AQLMModel Size=2-70, Bits=2.072024.06 | 77.7 | |
| QUIP#Model Size=2-70, Bits=32024.06 | 77.6 | |
| AQLMModel Size=2-70, Bits=4.142024.06 | 77.3 | |
| QUIP#Model Size=2-70, Bits=22024.06 | 77.1 | |
| QTIPModel Size=2-70, Bits=22024.06 | 76.3 | |
| DensePrune Rate=0%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 76.3 | |
| DenseSparsity=0%, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 76.26 | |
| QTIPModel Size=2-13, Bits=42024.06 | 73.6 | |
| FP16Model Size=2-13, Bits=162024.06 | 73.3 | |
| AQLMModel Size=2-13, Bits=3.942024.06 | 73.3 | |
| AQLMModel Size=2-13, Bits=3.032024.06 | 72.9 | |
| QTIPModel Size=2-13, Bits=32024.06 | 72.8 | |
| QUIP#Model Size=2-13, Bits=32024.06 | 72.5 | |
| QUIP#Model Size=2-13, Bits=42024.06 | 71.3 | |
| QTIPModel Size=2-13, Bits=22024.06 | 70.8 | |
| AQLMModel Size=2-7, Bits=4.042024.06 | 70.2 | |
| AQLMModel Size=2-13, Bits=1.972024.06 | 69.3 | |
| FP16Model Size=2-7, Bits=162024.06 | 69.3 | |
| QUIP#Model Size=2-13, Bits=22024.06 | 69 | |
| QTIPModel Size=2-7, Bits=42024.06 | 68.9 | |
| ALPSSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 68.86 | |
| QUIP#Model Size=2-7, Bits=42024.06 | 68.6 | |
| SparseGPTSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 68.56 | |
| QUIP#Model Size=2-7, Bits=32024.06 | 68.4 | |
| SparseLLMSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 68.35 | |
| L-ADMMSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 68.18 | |
| QTIPModel Size=2-7, Bits=32024.06 | 68.1 | |
| WandaSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 67.05 | |
| SAFESparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 66.84 | |
| AQLMModel Size=2-7, Bits=3.042024.06 | 66.8 | |
| L-ADMMSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 66.04 | |
| PG pruningPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 66.03 | |
| QTIPModel Size=2-7, Bits=22024.06 | 65.6 | |
| QUIP#Model Size=2-7, Bits=22024.06 | 65.3 | |
| ALPSSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 65.19 | |
| MagnitudeSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 64.81 | |
| ELSASparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 64.69 | |
| SparseGPTSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 64.06 | |
| AQLMModel Size=2-7, Bits=2.022024.06 | 63.7 | |
| SAFESparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 63.43 | |
| LLM-PrunerPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 63.42 | |
| Wanda-spPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 63.01 | |
| SparseLLMSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 61.91 | |
| MagnitudeSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 61.87 | |
| WandaSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 61.83 | |
| ELSASparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.10 | 61.24 | |
| BonsaiPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 59.93 | |
| PG pruningPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 56.94 | |
| SliceGPTPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 53.1 | |
| LLM-PrunerPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 48.31 | |
| BonsaiPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 48.11 | |
| Wanda-spPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 48.11 | |
| TMMFormer2026.05 | 43.43 | |
| AdamFormer2026.05 | 43.39 | |
| SliceGPTPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 42.13 | |
| AdamWFormer2026.05 | 41.88 | |
| VanillaTransformer2026.05 | 41.67 | |
| PG pruningPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 40.11 | |
| LLM-PrunerPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 36.48 | |
| SliceGPTPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 33.63 | |
| BonsaiPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 33.54 | |
| Wanda-spPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.06 | 29.12 |