Commonsense QA Suite (ARC-E, ARC-C, HellaS, WinoG, BoolQ, OBQA, RTE, CoPa, Race) Zero-Shot
81.19ARC-Easy AccuracyDense
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DenseBackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=0/32, Zero-shot=true, Training-free=true2026.05 | 81.19 | 53.41 | 78.92 | 73.64 | 82.11 | 44.8 | 69.68 | 87 | 39.14 | 67.77 | |
| DenseBackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=0/32, Zero-shot=true, Training-free=true2026.05 | 77.65 | 53.41 | 79.16 | 72.38 | 81.35 | 45 | 69.68 | 89 | 40 | 67.51 | |
| Ghosted LayersBackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 68.01 | 43 | 66.6 | 71.59 | 71.31 | 37.2 | 68.59 | 76 | 37.8 | 60.01 | |
| DenseBackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=0/32, Zero-shot=true, Training-free=true2026.05 | 65.87 | 42.41 | 74.35 | 67.8 | 82.91 | 41.2 | 69.68 | 89 | 41.63 | 63.87 | |
| Ghosted LayersBackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 65.82 | 43.69 | 66.55 | 71.27 | 74.34 | 37.2 | 66.43 | 79 | 36.56 | 60.1 | |
| ReplaceMe (Ls)Backbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 64.9 | 43.52 | 63.8 | 71.67 | 69.6 | 37.8 | 71.48 | 77 | 37.32 | 59.68 | |
| ReplaceMe (Ls)Backbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 63.13 | 43.86 | 64.07 | 72.85 | 71.31 | 38 | 68.59 | 77 | 36.27 | 59.45 | |
| Shortened LLaMABackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 61.32 | 33.11 | 59.55 | 54.22 | 43.76 | 35.2 | 51.62 | 77 | 31.29 | 49.67 | |
| Shortened LLaMABackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 58.84 | 32.68 | 59.16 | 53.75 | 45.38 | 34.4 | 54.15 | 75 | 30.72 | 49.34 | |
| ShortGPTBackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 58.29 | 42.15 | 64.96 | 68.35 | 61.99 | 34.4 | 69.68 | 80 | 34.45 | 57.14 | |
| Linear Patch (Rotate)Backbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 57.62 | 37.29 | 54.91 | 65.43 | 60.49 | 35.8 | 69.68 | 69 | 29.19 | 53.27 | |
| ReplaceMe (Cos)Backbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 57.03 | 37.29 | 52.14 | 64.25 | 39.36 | 35.8 | 62.82 | 68 | 31.1 | 49.75 | |
| ShortGPTBackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 56.65 | 42.41 | 64.69 | 71.35 | 65.14 | 32.8 | 67.87 | 75 | 34.16 | 56.67 | |
| Ghosted LayersBackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 55.81 | 37.03 | 61.3 | 67.25 | 68.47 | 37 | 72.92 | 81 | 39.43 | 57.8 | |
| ReplaceMe (Ls)Backbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 55.35 | 37.03 | 59.97 | 66.46 | 69.08 | 35.2 | 75.09 | 80 | 37.8 | 57.33 | |
| Linear Patch (Rotate)Backbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 54.08 | 36.18 | 53.29 | 64.25 | 72.97 | 33.8 | 62.82 | 72 | 32.92 | 53.59 | |
| ReplaceMe (Cos)Backbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 52.1 | 35.67 | 52.38 | 66.69 | 39.24 | 34.6 | 63.9 | 67 | 30.05 | 49.07 | |
| ReplaceMe (Cos)Backbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 51.09 | 36.09 | 53.48 | 64.17 | 58.01 | 36 | 58.84 | 74 | 33.49 | 51.69 | |
| Linear Patch (Diag)Backbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 51.09 | 35.32 | 49.59 | 62.27 | 62.78 | 34.6 | 66.43 | 73 | 30.05 | 51.68 | |
| Linear Patch (Rotate)Backbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 50.93 | 34.98 | 47.3 | 62.19 | 74.65 | 30.4 | 71.48 | 68 | 31.58 | 52.39 | |
| Linear Patch (Diag)Backbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 50.67 | 36.6 | 48.55 | 62.51 | 71.31 | 31 | 71.84 | 68 | 31 | 52.39 | |
| Linear Patch (Rotate)Backbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 50.51 | 34.56 | 49.9 | 63.77 | 57.49 | 33.4 | 67.15 | 68 | 30.14 | 50.55 | |
| Ghosted LayersBackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 50.08 | 34.64 | 52.73 | 69.3 | 72.63 | 31.8 | 69.68 | 72 | 32.44 | 53.92 | |
| LLM-StreamlineBackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 49.92 | 35.24 | 46.33 | 61.56 | 51.99 | 32.4 | 57.4 | 70 | 27.27 | 48.01 | |
| ShortGPTBackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 49.12 | 37.03 | 55.95 | 63.06 | 77.09 | 34 | 74.73 | 71 | 33.21 | 55.02 | |
| Shortened LLaMABackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 48.65 | 29.27 | 49.81 | 51.78 | 61.65 | 30.6 | 50.9 | 71 | 28.23 | 46.88 | |
| Linear Patch (Diag)Backbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 48.36 | 32.68 | 47.36 | 61.56 | 63.7 | 35 | 68.23 | 68 | 29.28 | 50.46 | |
| Ghosted LayersBackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 48.23 | 34.56 | 53.35 | 69.77 | 75.57 | 32.4 | 65.7 | 71 | 32.34 | 53.66 | |
| Linear Patch (Rotate)Backbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 48.15 | 34.56 | 45.04 | 61.4 | 75.47 | 31.6 | 66.79 | 68 | 31.29 | 51.37 | |
| Linear Patch (Diag)Backbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 46.34 | 35.15 | 47.72 | 61.01 | 71.74 | 31 | 70.76 | 68 | 30.91 | 51.4 | |
| Prune and CompBackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 46.25 | 30.89 | 44.22 | 59.12 | 53.91 | 35 | 60.29 | 67 | 28.61 | 47.25 | |
| Shortened LLaMABackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 45.71 | 29.69 | 55.66 | 57.7 | 64.65 | 30.4 | 50.54 | 76 | 30.62 | 49 | |
| Linear Patch (Diag)Backbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 45.58 | 34.9 | 43.97 | 58.33 | 77.46 | 31.6 | 68.23 | 64 | 29.57 | 50.4 | |
| Prune and CompBackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 44.99 | 31.06 | 43.44 | 56.12 | 53.12 | 31.8 | 60.65 | 64 | 26.79 | 45.77 | |
| ReplaceMe (Ls)Backbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 44.53 | 34.04 | 47.23 | 67.4 | 73.55 | 29.8 | 70.76 | 67 | 29.95 | 51.58 | |
| LLM-StreamlineBackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 44.19 | 33.11 | 33.39 | 56.99 | 38.2 | 32.6 | 58.12 | 61 | 25.84 | 42.6 | |
| Linear Patch (Diag)Backbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 43.86 | 31.74 | 44.14 | 60.85 | 61.25 | 33.6 | 65.34 | 68 | 29.09 | 48.65 | |
| Linear Patch (Rotate)Backbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 43.69 | 32.76 | 44.22 | 59.19 | 77.34 | 30.4 | 70.04 | 65 | 30.72 | 50.37 | |
| ReplaceMe (Cos)Backbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 43.35 | 32.59 | 37.02 | 56.75 | 58.13 | 29.6 | 68.23 | 62 | 31.96 | 46.63 | |
| Prune and CompBackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 42.97 | 29.69 | 41.64 | 58.88 | 52.84 | 33.8 | 62.09 | 70 | 27.08 | 46.55 | |
| ReplaceMe (Ls)Backbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 42.93 | 33.87 | 47.3 | 67.4 | 75.75 | 32.4 | 64.62 | 69 | 31.67 | 51.66 | |
| Ghosted LayersBackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 42.72 | 32.59 | 48.09 | 64.33 | 75.41 | 31.8 | 74.01 | 66 | 34.07 | 52.11 | |
| ReplaceMe (Cos)Backbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 42.68 | 33.45 | 38.27 | 58.56 | 61.9 | 29.2 | 62.09 | 60 | 30.05 | 46.24 | |
| Shortened LLaMABackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 41.75 | 28.84 | 42.84 | 54.3 | 55.23 | 27.8 | 53.79 | 70 | 26.99 | 44.62 | |
| ReplaceMe (Ls)Backbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 40.19 | 30.63 | 44.7 | 61.4 | 66.45 | 32 | 74.73 | 65 | 33.78 | 49.88 | |
| LLM-StreamlineBackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=7/32, Zero-shot=true, Training-free=true2026.05 | 39.69 | 28.84 | 33.18 | 55.49 | 38.07 | 29.6 | 57.4 | 60 | 24.02 | 40.7 | |
| LLM-StreamlineBackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 39.69 | 30.29 | 31.49 | 56.12 | 55.11 | 30.4 | 69.68 | 61 | 28.33 | 44.68 | |
| ShortGPTBackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 39.69 | 30.29 | 31.49 | 56.12 | 55.11 | 30.4 | 69.68 | 61 | 28.33 | 44.68 | |
| Shortened LLaMABackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 38.54 | 30.38 | 29.05 | 50.91 | 59.8 | 28.2 | 50.26 | 62 | 29.38 | 42.05 | |
| Prune and CompBackbone=LLaMA-3.1-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 38.51 | 27.3 | 40.5 | 53.28 | 62.08 | 29.4 | 53.79 | 57 | 25.17 | 43 | |
| LLM-StreamlineBackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 38.17 | 29.69 | 33.04 | 56.67 | 56.15 | 30.2 | 70.04 | 57 | 27.18 | 44.24 | |
| ShortGPTBackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 38.17 | 29.69 | 33.04 | 56.67 | 56.15 | 30.2 | 70.04 | 57 | 27.18 | 44.24 | |
| ReplaceMe (Cos)Backbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 38.05 | 30.55 | 40.74 | 54.93 | 77.52 | 28.6 | 67.51 | 65 | 30.81 | 48.19 | |
| LLM-StreamlineBackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 37.08 | 31.66 | 38.72 | 55.17 | 75.2 | 27.4 | 64.26 | 63 | 26.22 | 46.52 | |
| ShortGPTBackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 37.08 | 31.66 | 38.72 | 55.17 | 75.2 | 27.4 | 64.26 | 63 | 26.22 | 46.52 | |
| Prune and CompBackbone=DeepSeek-R1-Distill-LLaMA-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 36.45 | 29.1 | 36.32 | 50.99 | 64.62 | 27.4 | 60.29 | 56 | 24.4 | 42.84 | |
| Prune and CompBackbone=LLaMA-3-8B, Pruning Ratio (Lp/Lt)=11/32, Zero-shot=true, Training-free=true2026.05 | 32.28 | 25 | 37.78 | 50.99 | 55.9 | 30.4 | 49.46 | 58 | 23.25 | 40.34 |