Zero-shot Reasoning on MathQA
28.4AccuracyLlama2-7B
Evaluation results
| Method | Links | |
|---|---|---|
| Llama2-7BBackbone=Llama2-7B2026.02 | 28.4 | |
| BaselineRatio=1.0, Memory Footprint (GB)=12.6GB, Zero-shot=true2026.04 | 27 | |
| COMPOTBackbone=Llama2-7B, Training-free=true, CR=0.22026.02 | 26.2 | |
| COMPOTBackbone=Llama2-7B, Training-free=true, CR=0.42026.02 | 23.6 | |
| Swift-SVDRatio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 23 | |
| Swift-SVD*Ratio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 23 | |
| Dobi-SVDBackbone=Llama2-7B, Training-free=false, CR=0.22026.02 | 22.7 | |
| COMPOTBackbone=Llama2-7B, Training-free=true, CR=0.62026.02 | 22.1 | |
| Dobi-SVDBackbone=Llama2-7B, Training-free=false, CR=0.62026.02 | 22 | |
| Swift-SVDRatio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 22 | |
| Swift-SVD*Ratio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 22 | |
| Dobi-SVDBackbone=Llama2-7B, Training-free=false, CR=0.42026.02 | 21.3 | |
| SVD-LLM(W)Ratio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 21 | |
| Swift-SVDRatio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 21 | |
| Swift-SVD*Ratio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 21 | |
| Dobi-SVD(w)Ratio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 20 | |
| Dobi-SVD(w)Ratio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 18 | |
| ASVDRatio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 17 | |
| Dobi-SVD(w)Ratio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 15 | |
| SVD-LLM(W)Ratio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 12 | |
| ASVDRatio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 8 | |
| FWSVDRatio=0.8, Memory Footprint (GB)=10.1 GB, Zero-shot=true2026.04 | 5 | |
| ASVDRatio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 5 | |
| SVD-LLM(W)Ratio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 4 | |
| FWSVDRatio=0.6, Memory Footprint (GB)=7.7 GB, Zero-shot=true2026.04 | 3 | |
| FWSVDRatio=0.4, Memory Footprint (GB)=5.3 GB, Zero-shot=true2026.04 | 3 |