Zero-shot Commonsense Reasoning on PIQA, HellaSwag, WinoGrande, ARC-Easy, OpenBookQA, and MathQA (test)
59Zero-shot AccuracyOriginal
Evaluation Results
| Method | Links | |
|---|---|---|
| OriginalModel Backbone=LLaMA-13B, Evaluation Protocol=Zero-shot2026.05 | 59 | |
| OriginalModel Backbone=Vicuna-7B, Evaluation Protocol=Zero-shot2026.05 | 56 | |
| ZS-SVDModel Backbone=LLaMA-13B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 56 | |
| IO-SVDModel Backbone=LLaMA-13B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 56 | |
| SVDLLMModel Backbone=LLaMA-13B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 55 | |
| ZS-SVDModel Backbone=Vicuna-7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 54 | |
| ASVDModel Backbone=LLaMA-13B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 54 | |
| IO-SVDModel Backbone=Vicuna-7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 53 | |
| OriginalModel Backbone=OPT-6.7B, Evaluation Protocol=Zero-shot2026.05 | 52 | |
| ZS-SVDModel Backbone=OPT-6.7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 51 | |
| IO-SVDModel Backbone=OPT-6.7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 51 | |
| SVDLLMModel Backbone=Vicuna-7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 51 | |
| FWSVDModel Backbone=LLaMA-13B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 43 | |
| SVDLLMModel Backbone=OPT-6.7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 41 | |
| ASVDModel Backbone=Vicuna-7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 33 | |
| ASVDModel Backbone=OPT-6.7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 32 | |
| SVDModel Backbone=LLaMA-13B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 21 | |
| FWSVDModel Backbone=Vicuna-7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 9 | |
| FWSVDModel Backbone=OPT-6.7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 6 | |
| SVDModel Backbone=Vicuna-7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 5 | |
| SVDModel Backbone=OPT-6.7B, Pruning Ratio=20%, Evaluation Protocol=Zero-shot2026.05 | 3 |