List your company
ResearchFormerly WizWand

Zero-shot Reasoning on ARC-e, PIQA, OpenbookQA, Winogrande, HellaSwag, and MathQA

57Average AccuracyBaseline
0.8415.423044.58Apr 2, 2026Apr 14, 2026Apr 27, 2026May 10, 2026May 23, 2026Jun 5, 2026Jun 18, 2026
Updated 4mo ago

Evaluation results

MethodLinks
BaselineRatio=1.0, Memory Footprint (GB)=12.6GB, Zero-shot=true2026.0457
Base ModelParameter Rate=100%2026.0657
Swift-SVD*Ratio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.0451
Swift-SVDRatio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.0450
AIRParameter Rate=80%2026.0649.9
SVD-LLM(W)Ratio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.0449
Dobi-SVD(w)Ratio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.0449
SVD-LLM(W)Parameter Rate=80%2026.0648.8
ASVDRatio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.0445
Swift-SVD*Ratio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.0444
Swift-SVDRatio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.0443
AIRParameter Rate=60%2026.0641.6
Dobi-SVD(w)Ratio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.0441
SVD-LLM(W)Parameter Rate=60%2026.0640
ASVDParameter Rate=80%2026.0639.5
SVD-LLM(W)Ratio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.0438
Swift-SVDRatio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.0434
Swift-SVD*Ratio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.0434
AIRParameter Rate=40%2026.0633.6
SVD-LLM(W)Parameter Rate=40%2026.0633.3
Vanilla SVDParameter Rate=80%2026.0632.8
Vanilla SVDParameter Rate=20%2026.0632.4
Vanilla SVDParameter Rate=60%2026.0632.1
Vanilla SVDParameter Rate=40%2026.0631.8
AIRParameter Rate=20%2026.0631.7
FWSVDParameter Rate=40%2026.0631.5
ASVDParameter Rate=40%2026.0631.4
FWSVDParameter Rate=80%2026.0631.3
ASVDParameter Rate=60%2026.0631.3
SVD-LLM(W)Parameter Rate=20%2026.0631.3
FWSVDParameter Rate=20%2026.0631.2
ASVDParameter Rate=20%2026.0631.2
FWSVDParameter Rate=60%2026.0631.1
Dobi-SVD(w)Ratio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.0430
SVD-LLM(W)Ratio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.0411
ASVDRatio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.0410
FWSVDRatio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.048
ASVDRatio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.046
FWSVDRatio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.044
FWSVDRatio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.043