Mathematical Reasoning on GSM8K (test) (Accuracy, Tokens, CR, TE)
94.39AccuracyLC-Prompt
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LC-PromptModel=Qwen2.5-14B, Compression Strength=High2026.01 | 94.39 | 246.98 | 79 | 38.22 | |
| LC-PromptModel=Qwen2.5-14B, Compression Strength=Mid2026.01 | 93.78 | 276.52 | 88 | 33.92 | |
| LC-PromptModel=Qwen2.5-14B, Compression Strength=Low2026.01 | 93.33 | 285.6 | 91 | 32.68 | |
| OriginalModel=Qwen2.5-14B, Compression Strength=None2026.01 | 93.03 | 313.94 | 100 | 29.63 | |
| TokenSkipModel=Qwen2.5-14B, Compression Strength=Low2026.01 | 92.95 | 224.26 | 71 | 41.45 | |
| CtrlCoTModel=Qwen2.5-14B, Compression Strength=Low2026.01 | 92.72 | 210.24 | 67 | 44.1 | |
| CtrlCoTModel=Qwen2.5-14B, Compression Strength=Mid2026.01 | 92.04 | 185.41 | 59 | 49.64 | |
| TokenSkipModel=Qwen2.5-14B, Compression Strength=Mid2026.01 | 91.89 | 191.24 | 61 | 48.05 | |
| OriginalModel=Qwen2.5-7B, Compression Strength=None2026.01 | 91.58 | 299.22 | 100 | 3.27 | |
| CtrlCoTModel=Qwen2.5-14B, Compression Strength=High2026.01 | 90.67 | 139.09 | 44 | 65.19 | |
| LC-PromptModel=Qwen2.5-7B, Compression Strength=Mid2026.01 | 90.37 | 238.85 | 80 | 37.84 | |
| TokenSkipModel=Qwen2.5-14B, Compression Strength=High2026.01 | 90.37 | 158.44 | 50 | 57.04 | |
| LC-PromptModel=Qwen2.5-7B, Compression Strength=Low2026.01 | 89.92 | 243.41 | 81 | 36.94 | |
| LC-PromptModel=Qwen2.5-7B, Compression Strength=High2026.01 | 89.84 | 214.85 | 72 | 41.81 | |
| CtrlCoTModel=Qwen2.5-7B, Compression Strength=Low2026.01 | 89.31 | 198.11 | 66 | 45.08 | |
| TokenSkipModel=Qwen2.5-7B, Compression Strength=Low2026.01 | 88.63 | 209.33 | 70 | 42.34 | |
| CtrlCoTModel=Qwen2.5-7B, Compression Strength=Mid2026.01 | 87.72 | 170.74 | 57 | 51.37 | |
| TokenSkipModel=Qwen2.5-7B, Compression Strength=Mid2026.01 | 86.35 | 171.7 | 57 | 50.29 | |
| CtrlCoTModel=Qwen2.5-7B, Compression Strength=High2026.01 | 85.82 | 138.41 | 46 | 62.01 | |
| TokenSkipModel=Qwen2.5-7B, Compression Strength=High2026.01 | 83.4 | 149.43 | 50 | 55.81 | |
| LC-PromptModel=Qwen2.5-3B, Compression Strength=High2026.01 | 83.32 | 279.85 | 88 | 29.77 | |
| OriginalModel=Qwen2.5-3B, Compression Strength=None2026.01 | 83.24 | 316.94 | 100 | 3.81 | |
| LC-PromptModel=Qwen2.5-3B, Compression Strength=Low2026.01 | 82.87 | 294.62 | 93 | 28.13 | |
| LC-PromptModel=Qwen2.5-3B, Compression Strength=Mid2026.01 | 82.79 | 296.34 | 94 | 27.94 | |
| TokenSkipModel=Qwen2.5-3B, Compression Strength=Low2026.01 | 79.98 | 230.42 | 73 | 34.71 | |
| CtrlCoTModel=Qwen2.5-3B, Compression Strength=Low2026.01 | 79.83 | 193.43 | 61 | 41.27 | |
| TruncationModel=Qwen2.5-7B, Compression Strength=Low2026.01 | 78.47 | 283.86 | 95 | 27.64 | |
| CtrlCoTModel=Qwen2.5-3B, Compression Strength=Mid2026.01 | 77.1 | 125.44 | 40 | 61.47 | |
| TruncationModel=Qwen2.5-14B, Compression Strength=Low2026.01 | 76.19 | 295.15 | 94 | 25.82 | |
| TokenSkipModel=Qwen2.5-3B, Compression Strength=Mid2026.01 | 75.74 | 186.18 | 59 | 40.68 | |
| CtrlCoTModel=Qwen2.5-3B, Compression Strength=High2026.01 | 75.59 | 112.76 | 36 | 67.03 | |
| TokenSkipModel=Qwen2.5-3B, Compression Strength=High2026.01 | 71.65 | 157.11 | 50 | 45.6 | |
| TruncationModel=Qwen2.5-3B, Compression Strength=Low2026.01 | 69.29 | 296.88 | 94 | 23.34 | |
| TruncationModel=Qwen2.5-7B, Compression Strength=Mid2026.01 | 64.75 | 267.78 | 89 | 24.18 | |
| TruncationModel=Qwen2.5-14B, Compression Strength=Mid2026.01 | 60.8 | 275.82 | 88 | 22.04 | |
| TruncationModel=Qwen2.5-3B, Compression Strength=Mid2026.01 | 54.21 | 276.08 | 87 | 19.63 | |
| TruncationModel=Qwen2.5-7B, Compression Strength=High2026.01 | 45.64 | 240.98 | 81 | 18.94 | |
| TruncationModel=Qwen2.5-14B, Compression Strength=High2026.01 | 38.67 | 244.96 | 78 | 15.78 | |
| TruncationModel=Qwen2.5-3B, Compression Strength=High2026.01 | 36.32 | 244.22 | 77 | 14.87 |