Commonsense Reasoning on OpenBookQA, ARC-E, ARC-C, WinoGrande, PIQA, MathQA, HellaSwag
34OpenBookQADense
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| DenseRatio=1.0, zero-shot evaluation=true2026.04 | 34 | 80 | 50 | 73 | 79 | 43 | 60 | 60 | — | |
| AA-SVDRatio=0.8, zero-shot evaluation=true2026.04 | 31 | 74 | 41 | 69 | 73 | 37 | 49 | 53 | 10.7 | |
| SVD-LLMRatio=0.8, zero-shot evaluation=true2026.04 | 25 | 67 | 31 | 64 | 68 | 32 | 41 | 47 | 21.7 | |
| AA-SVDRatio=0.6, zero-shot evaluation=true2026.04 | 25 | 59 | 28 | 61 | 65 | 28 | 39 | 44 | 27.2 | |
| AA-SVDRatio=0.4, zero-shot evaluation=true2026.04 | 20 | 44 | 23 | 57 | 60 | 23 | 33 | 37 | 37.9 | |
| SVD-LLMRatio=0.6, zero-shot evaluation=true2026.04 | 15 | 36 | 20 | 53 | 56 | 22 | 29 | 33 | 44.9 | |
| SVD-LLMRatio=0.4, zero-shot evaluation=true2026.04 | 12 | 28 | 20 | 49 | 54 | 21 | 27 | 30 | 49.6 |