List your company
ResearchFormerly WizWand

Question Answering on Commonsense QA Suite (WinoGrande, HellaSwag, ARC-e, ARC-c, PIQA)

72.7Avg AccuracyLLaMA-3 8B
46.80453.52760.2566.973Feb 5, 2026
Updated 8mo ago

Evaluation results

MethodLinks
LLaMA-3 8BPruning Ratio=0%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0272.7
LLaMA-2 7BPruning Ratio=0%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0268.99
MoPPruning Ratio=20%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0265.44
MoPPruning Ratio=20%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0265.22
AmoebaLLMPruning Ratio=20%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0264.9
SlimLLMPruning Ratio=20%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0264
AMPPruning Ratio=20%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0263.48
CoMePruning Ratio=20%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0262.93
LINEARPATCHPruning Ratio=20%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0262.75
AMPPruning Ratio=20%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0262.72
LINEARPATCHPruning Ratio=20%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0262.51
CoMePruning Ratio=20%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0262.41
PruneNetPruning Ratio=20%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0262.34
MoPPruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0261.54
AMPPruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0261.02
ModHiFi-PPruning Ratio=20%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0260.62
CoMePruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0260.47
MoPPruning Ratio=30%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0260.43
DISP-LLMPruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0259.53
LINEARPATCHPruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0259.39
SliceGPTPruning Ratio=20%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0258.18
AMPPruning Ratio=30%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0258.01
PruneNetPruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0257.08
Yang et al.Pruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0256.65
MoPPruning Ratio=40%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0255.37
MoPPruning Ratio=40%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0255.34
Yang et al.Pruning Ratio=30%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0254.34
AMPPruning Ratio=40%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0253.06
AMPPruning Ratio=40%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0252.65
CoMePruning Ratio=30%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0252.5
ModHiFi-PPruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0252.44
Shortened LLaMAPruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0251.56
SliceGPTPruning Ratio=30%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0251.5
Yang et al.Pruning Ratio=40%, Base Model=LLaMA-2 7B, Evaluation Protocol=Zero-shot2026.0250.39
Yang et al.Pruning Ratio=40%, Base Model=LLaMA-3 8B, Evaluation Protocol=Zero-shot2026.0247.8