List your company
ResearchFormerly WizWand

Zero-shot Accuracy on MMLU, PIQA, ARC-E, ARC-C, Winogrande, and OBQA

63.89Avg. Accuracy (Zero-Shot)Dense
32.627640.743848.8656.9762May 17, 2026
Updated 5mo ago

Evaluation results

MethodLinks
DenseModel=LLaMA-3.1 8B, Sparsity=0%2026.0563.89
DenseModel=LLaMA-3.2 1B, Sparsity=0%2026.0557.95
LEAPModel=LLaMA-3.1 8B, Sparsity=50%, Pruning Structure=Unstructured2026.0557.71
ADMMModel=LLaMA-3.1 8B, Sparsity=50%, Pruning Structure=Unstructured2026.0557.5
SparseGPTModel=LLaMA-3.1 8B, Sparsity=50%, Pruning Structure=Unstructured2026.0557.33
ThanosModel=LLaMA-3.1 8B, Sparsity=50%, Pruning Structure=Unstructured2026.0556.82
WandaModel=LLaMA-3.1 8B, Sparsity=50%, Pruning Structure=Unstructured2026.0555.81
MaskLLMModel=LLaMA-3.1 8B, Sparsity=50%, Pruning Structure=2:4 semi-structured2026.0555.09
LEAPModel=LLaMA-3.1 8B, Sparsity=60%, Pruning Structure=Unstructured2026.0554.47
LEAPModel=LLaMA-3.2 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0554.44
ADMMModel=LLaMA-3.2 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0552.28
ThanosModel=LLaMA-3.2 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0550.81
ADMMModel=LLaMA-3.1 8B, Sparsity=60%, Pruning Structure=Unstructured2026.0550.61
LEAPModel=LLaMA-3.2 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0550.39
SparseGPTModel=LLaMA-3.2 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0550.2
WandaModel=LLaMA-3.2 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0549.95
SparseGPTModel=LLaMA-3.1 8B, Sparsity=60%, Pruning Structure=Unstructured2026.0549.63
DenseModel=Qwen-2.5 0.5B, Sparsity=0%2026.0549.1
DenseModel=Gemma-3 1B, Sparsity=0%2026.0549.09
ThanosModel=LLaMA-3.1 8B, Sparsity=60%, Pruning Structure=Unstructured2026.0548.87
DenseModel=LLaMA-3.2 3B, Sparsity=0%2026.0548.48
WandaModel=LLaMA-3.1 8B, Sparsity=60%, Pruning Structure=Unstructured2026.0545.19
ADMMModel=LLaMA-3.2 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0544.99
LEAPModel=Qwen-2.5 0.5B, Sparsity=50%, Pruning Structure=Unstructured2026.0544.93
LEAPModel=Gemma-3 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0544.81
ADMMModel=Qwen-2.5 0.5B, Sparsity=50%, Pruning Structure=Unstructured2026.0544.56
LEAPModel=LLaMA-3.2 3B, Sparsity=50%, Pruning Structure=Unstructured2026.0544.53
ThanosModel=Qwen-2.5 0.5B, Sparsity=50%, Pruning Structure=Unstructured2026.0543.88
SparseGPTModel=LLaMA-3.2 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0543.78
LEAPModel=Qwen-2.5 0.5B, Sparsity=60%, Pruning Structure=Unstructured2026.0543.41
MaskLLMModel=Gemma-3 1B, Sparsity=50%, Pruning Structure=2:4 semi-structured2026.0543.39
SparseGPTModel=Qwen-2.5 0.5B, Sparsity=50%, Pruning Structure=Unstructured2026.0543.17
ADMMModel=Gemma-3 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0543.05
MaskLLMModel=LLaMA-3.2 1B, Sparsity=50%, Pruning Structure=2:4 semi-structured2026.0542.59
ThanosModel=LLaMA-3.2 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0542.49
LEAPModel=Gemma-3 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0542.42
SparseGPTModel=Gemma-3 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0542.32
WandaModel=Qwen-2.5 0.5B, Sparsity=50%, Pruning Structure=Unstructured2026.0542.29
ADMMModel=LLaMA-3.2 3B, Sparsity=50%, Pruning Structure=Unstructured2026.0542.28
ThanosModel=LLaMA-3.2 3B, Sparsity=50%, Pruning Structure=Unstructured2026.0542.1
SparseGPTModel=LLaMA-3.2 3B, Sparsity=50%, Pruning Structure=Unstructured2026.0541.93
WandaModel=LLaMA-3.2 3B, Sparsity=50%, Pruning Structure=Unstructured2026.0541.71
ThanosModel=Gemma-3 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0541.62
LEAPModel=LLaMA-3.2 3B, Sparsity=60%, Pruning Structure=Unstructured2026.0541.53
MaskLLMModel=Qwen-2.5 0.5B, Sparsity=50%, Pruning Structure=2:4 semi-structured2026.0540.91
ADMMModel=Qwen-2.5 0.5B, Sparsity=60%, Pruning Structure=Unstructured2026.0540.41
WandaModel=Gemma-3 1B, Sparsity=50%, Pruning Structure=Unstructured2026.0539.98
ThanosModel=Qwen-2.5 0.5B, Sparsity=60%, Pruning Structure=Unstructured2026.0538.94
WandaModel=LLaMA-3.2 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0538.77
ADMMModel=Gemma-3 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0538.73
SparseGPTModel=Qwen-2.5 0.5B, Sparsity=60%, Pruning Structure=Unstructured2026.0538.65
ADMMModel=LLaMA-3.2 3B, Sparsity=60%, Pruning Structure=Unstructured2026.0538.33
ThanosModel=LLaMA-3.2 3B, Sparsity=60%, Pruning Structure=Unstructured2026.0537.64
SparseGPTModel=LLaMA-3.2 3B, Sparsity=60%, Pruning Structure=Unstructured2026.0537.29
ThanosModel=Gemma-3 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0536.95
SparseGPTModel=Gemma-3 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0536.78
WandaModel=Qwen-2.5 0.5B, Sparsity=60%, Pruning Structure=Unstructured2026.0536.64
WandaModel=LLaMA-3.2 3B, Sparsity=60%, Pruning Structure=Unstructured2026.0534.66
WandaModel=Gemma-3 1B, Sparsity=60%, Pruning Structure=Unstructured2026.0533.83