Zero-Shot Common Sense Reasoning and QA on (ARC-e, ARC-c, HellaSwag, OBQA, WinoGrande, MathQA, PIQA)
83.54ARC-eDense
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| DenseModel=Qwen3-8B, Compression Rate=Dense2025.12 | 83.54 | 55.97 | 57.13 | 31 | 67.8 | 49.61 | 76.88 | 60.28 | — | |
| SkipCatModel=Qwen3-8B, Compression Rate=20%2025.12 | 78.96 | 49.49 | 52.47 | 29.6 | 69.38 | 40.37 | 74.65 | 56.42 | 3.86 | |
| DenseModel=LLaMA2-7B, Compression Rate=Dense2025.12 | 76.3 | 43.34 | 57.14 | 31.4 | 69.14 | 28.17 | 78.07 | 54.79 | — | |
| SkipCatModel=Qwen3-8B, Compression Rate=30%2025.12 | 74.28 | 42.41 | 46.57 | 28.8 | 65.43 | 32.16 | 72.31 | 51.71 | 8.57 | |
| ASVDModel=Qwen3-8B, Compression Rate=20%2025.12 | 73.99 | 41.72 | 42.02 | 26.4 | 63.3 | 31.42 | 72.09 | 50.13 | 10.14 | |
| SkipCatModel=LLaMA2-7B, Compression Rate=20%2025.12 | 73.23 | 40.02 | 51.9 | 31 | 68.43 | 27.71 | 75.84 | 52.59 | 2.2 | |
| SVD-LLMModel=Qwen3-8B, Compression Rate=20%2025.12 | 71.38 | 44.54 | 47.29 | 28.8 | 66.46 | 30.99 | 72.14 | 51.66 | 8.62 | |
| SkipCatModel=LLaMA2-7B, Compression Rate=30%2025.12 | 68.31 | 35.67 | 45.95 | 26.2 | 65.98 | 24.66 | 72.42 | 48.46 | 6.34 | |
| ASVDModel=LLaMA2-7B, Compression Rate=20%2025.12 | 67.8 | 34.56 | 48.25 | 29.6 | 63.77 | 25.49 | 72.2 | 48.81 | 5.98 | |
| Basis SharingModel=LLaMA2-7B, Compression Rate=20%2025.12 | 59.18 | 27.82 | 38.22 | 24.2 | 66.54 | 23.89 | 66.54 | 43.77 | 11.02 | |
| SVD-LLMModel=LLaMA2-7B, Compression Rate=20%2025.12 | 58.67 | 27.65 | 43.1 | 26.2 | 64.25 | 23.85 | 70.18 | 44.84 | 9.95 | |
| SVD-LLMModel=Qwen3-8B, Compression Rate=30%2025.12 | 58.08 | 33.28 | 40.18 | 23.6 | 61.72 | 25.33 | 68.23 | 44.35 | 15.93 | |
| Dobi-SVDModel=LLaMA2-7B, Compression Rate=20%2025.12 | 54.25 | 23.29 | 38.8 | 22.8 | 58.56 | 22.75 | 65.34 | 40.83 | 13.97 | |
| SVD-LLMModel=LLaMA2-7B, Compression Rate=30%2025.12 | 52.9 | 24.06 | 38.01 | 22 | 61.72 | 22.88 | 67.19 | 41.25 | 13.54 | |
| Basis SharingModel=LLaMA2-7B, Compression Rate=30%2025.12 | 51.22 | 22.95 | 34.25 | 19.6 | 59.43 | 23.82 | 61.92 | 39.03 | 15.77 | |
| ASVDModel=Qwen3-8B, Compression Rate=30%2025.12 | 47.98 | 23.89 | 30.57 | 17.6 | 50.99 | 23.08 | 61.64 | 36.54 | 23.74 | |
| ASVDModel=LLaMA2-7B, Compression Rate=30%2025.12 | 34.89 | 23.12 | 29.89 | 13.4 | 51.62 | 22.08 | 56.86 | 33.12 | 21.67 |