List your company
ResearchFormerly WizWand

Zero-shot Commonsense Reasoning Suite (PIQA, HellaSwag, WinoGrande, ARC-Easy, ARC-Challenge)

78PIQA AccuracyBaseline
53.0459.526672.48May 15, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BaselineCompression Ratio=1.0, Backbone=LLaMA-2-7B2026.05785769764365
IO-SVDCompression Ratio=0.6, Backbone=LLaMA-2-7B, Evaluation Protocol=Loss-aware Remapping (‡)2026.05744767733860
ZS-SVDCompression Ratio=0.4, Backbone=LLaMA-2-7B, Evaluation Protocol=Vanilla Remapping + 8-bit HQ (†)2026.05734868703659
IO-SVDCompression Ratio=0.4, Backbone=LLaMA-2-7B, Evaluation Protocol=Loss-aware Remapping + 8-bit HQ (†)2026.05734865713759
BonsaiCompression Ratio=0.6, Backbone=LLaMA-2-7B2026.05724558593053
Dobi-SVDCompression Ratio=0.6, Backbone=LLaMA-2-7B, Evaluation Protocol=Vanilla Remapping (*)2026.05724564673156
ZS-SVDCompression Ratio=0.6, Backbone=LLaMA-2-7B, Evaluation Protocol=Vanilla Remapping (*)2026.05724667663357
LLM-PrunerCompression Ratio=0.6, Backbone=LLaMA-2-7B2026.05704153532748
Wanda-spCompression Ratio=0.6, Backbone=LLaMA-2-7B2026.05704253572950
Dobi-SVDCompression Ratio=0.4, Backbone=LLaMA-2-7B, Evaluation Protocol=Vanilla Remapping (*)2026.05673857552649
SliceGPTCompression Ratio=0.6, Backbone=LLaMA-2-7B2026.05655760433251
ZS-SVDCompression Ratio=0.6, Backbone=LLaMA-2-7B2026.05633460462545
IO-SVDCompression Ratio=0.6, Backbone=LLaMA-2-7B2026.05613359512345
SVD-LLMCompression Ratio=0.6, Backbone=LLaMA-2-7B2026.05563057392141
SVD-LLMCompression Ratio=0.4, Backbone=LLaMA-2-7B2026.05542748262035
ZS-SVDCompression Ratio=0.4, Backbone=LLaMA-2-7B2026.05542752291936
IO-SVDCompression Ratio=0.4, Backbone=LLaMA-2-7B2026.05542852301937