Zero-shot Reasoning on ARC-e, PIQA, OpenbookQA, Winogrande, HellaSwag, and MathQA
57Average AccuracyBaseline
Evaluation Results
| Method | Links | |
|---|---|---|
| BaselineRatio=1.0, Memory Footprint (GB)=12.6GB, Zero-shot=true2026.04 | 57 | |
| Base ModelParameter Rate=100%2026.06 | 57 | |
| Swift-SVD*Ratio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 51 | |
| Swift-SVDRatio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 50 | |
| AIRParameter Rate=80%2026.06 | 49.9 | |
| SVD-LLM(W)Ratio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 49 | |
| Dobi-SVD(w)Ratio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 49 | |
| SVD-LLM(W)Parameter Rate=80%2026.06 | 48.8 | |
| ASVDRatio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 45 | |
| Swift-SVD*Ratio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 44 | |
| Swift-SVDRatio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 43 | |
| AIRParameter Rate=60%2026.06 | 41.6 | |
| Dobi-SVD(w)Ratio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 41 | |
| SVD-LLM(W)Parameter Rate=60%2026.06 | 40 | |
| ASVDParameter Rate=80%2026.06 | 39.5 | |
| SVD-LLM(W)Ratio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 38 | |
| Swift-SVDRatio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 34 | |
| Swift-SVD*Ratio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 34 | |
| AIRParameter Rate=40%2026.06 | 33.6 | |
| SVD-LLM(W)Parameter Rate=40%2026.06 | 33.3 | |
| Vanilla SVDParameter Rate=80%2026.06 | 32.8 | |
| Vanilla SVDParameter Rate=20%2026.06 | 32.4 | |
| Vanilla SVDParameter Rate=60%2026.06 | 32.1 | |
| Vanilla SVDParameter Rate=40%2026.06 | 31.8 | |
| AIRParameter Rate=20%2026.06 | 31.7 | |
| FWSVDParameter Rate=40%2026.06 | 31.5 | |
| ASVDParameter Rate=40%2026.06 | 31.4 | |
| FWSVDParameter Rate=80%2026.06 | 31.3 | |
| ASVDParameter Rate=60%2026.06 | 31.3 | |
| SVD-LLM(W)Parameter Rate=20%2026.06 | 31.3 | |
| FWSVDParameter Rate=20%2026.06 | 31.2 | |
| ASVDParameter Rate=20%2026.06 | 31.2 | |
| FWSVDParameter Rate=60%2026.06 | 31.1 | |
| Dobi-SVD(w)Ratio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 30 | |
| SVD-LLM(W)Ratio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 11 | |
| ASVDRatio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 10 | |
| FWSVDRatio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 8 | |
| ASVDRatio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 6 | |
| FWSVDRatio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 4 | |
| FWSVDRatio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 3 |