List your company
ResearchFormerly WizWand

Zero-shot Accuracy on ARC Easy

78.2Zero-shot Acc (ARC Easy)QTIP
27.156840.408453.6666.9116Jun 15, 2024Oct 10, 2024Feb 5, 2025Jun 3, 2025Sep 29, 2025Jan 25, 2026May 23, 2026
Updated 5mo ago

Evaluation results

MethodLinks
QTIPModel Size=2-70, Bits=32024.0678.2
AQLMModel Size=2-70, Bits=3.012024.0678
QTIPModel Size=2-70, Bits=42024.0677.8
FP16Model Size=2-70, Bits=162024.0677.7
QUIP#Model Size=2-70, Bits=42024.0677.7
AQLMModel Size=2-70, Bits=2.072024.0677.7
QUIP#Model Size=2-70, Bits=32024.0677.6
AQLMModel Size=2-70, Bits=4.142024.0677.3
QUIP#Model Size=2-70, Bits=22024.0677.1
QTIPModel Size=2-70, Bits=22024.0676.3
DensePrune Rate=0%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0676.3
DenseSparsity=0%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1076.26
QTIPModel Size=2-13, Bits=42024.0673.6
FP16Model Size=2-13, Bits=162024.0673.3
AQLMModel Size=2-13, Bits=3.942024.0673.3
AQLMModel Size=2-13, Bits=3.032024.0672.9
QTIPModel Size=2-13, Bits=32024.0672.8
QUIP#Model Size=2-13, Bits=32024.0672.5
QUIP#Model Size=2-13, Bits=42024.0671.3
QTIPModel Size=2-13, Bits=22024.0670.8
AQLMModel Size=2-7, Bits=4.042024.0670.2
AQLMModel Size=2-13, Bits=1.972024.0669.3
FP16Model Size=2-7, Bits=162024.0669.3
QUIP#Model Size=2-13, Bits=22024.0669
QTIPModel Size=2-7, Bits=42024.0668.9
ALPSSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1068.86
QUIP#Model Size=2-7, Bits=42024.0668.6
SparseGPTSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1068.56
QUIP#Model Size=2-7, Bits=32024.0668.4
SparseLLMSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1068.35
L-ADMMSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1068.18
QTIPModel Size=2-7, Bits=32024.0668.1
WandaSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1067.05
SAFESparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1066.84
AQLMModel Size=2-7, Bits=3.042024.0666.8
L-ADMMSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1066.04
PG pruningPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0666.03
QTIPModel Size=2-7, Bits=22024.0665.6
QUIP#Model Size=2-7, Bits=22024.0665.3
ALPSSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1065.19
MagnitudeSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1064.81
ELSASparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1064.69
SparseGPTSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1064.06
AQLMModel Size=2-7, Bits=2.022024.0663.7
SAFESparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1063.43
LLM-PrunerPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0663.42
Wanda-spPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0663.01
SparseLLMSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1061.91
MagnitudeSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1061.87
WandaSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1061.83
ELSASparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1061.24
BonsaiPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0659.93
PG pruningPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0656.94
SliceGPTPrune Rate=30%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0653.1
LLM-PrunerPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0648.31
BonsaiPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0648.11
Wanda-spPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0648.11
TMMFormer2026.0543.43
AdamFormer2026.0543.39
SliceGPTPrune Rate=40%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0642.13
AdamWFormer2026.0541.88
VanillaTransformer2026.0541.67
PG pruningPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0640.11
LLM-PrunerPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0636.48
SliceGPTPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0633.63
BonsaiPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0633.54
Wanda-spPrune Rate=50%, Backbone=LLaMA-2-7B, Evaluation Protocol=Zero-shot2024.0629.12