Reasoning on BRUMO25 (avg@k, Token reduction)
78.75Avg@k ScoreType IV (STOP)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Type IV (STOP)Model=DS-Qwen-3-8B2026.04 | 78.75 | 277.5 | 78.98 | |
| Type IModel=DS-Qwen-3-8B2026.04 | 76.25 | 284.8 | 78.43 | |
| Type IIModel=DS-Qwen-3-8B2026.04 | 75.83 | 394.9 | 70.1 | |
| No pruning (Baseline)Model=DS-Qwen-3-8B2026.04 | 75 | 1,320 | — | |
| Type IIIModel=DS-Qwen-3-8B2026.04 | 74.58 | 280.2 | 78.78 | |
| Type IV (STOP)Model=GPT-OSS-20B2026.04 | 70 | 183.6 | 68.11 | |
| Type IModel=GPT-OSS-20B2026.04 | 69.17 | 187.6 | 67.41 | |
| No pruning (Baseline)Model=GPT-OSS-20B2026.04 | 68.02 | 575.6 | — | |
| Type IIIModel=GPT-OSS-20B2026.04 | 67.92 | 179 | 68.9 | |
| Type IIModel=GPT-OSS-20B2026.04 | 66.25 | 298.8 | 48.09 | |
| Type IV (STOP)Model=DS-Qwen-2.5-7B2026.04 | 56.67 | 190.2 | 71.03 | |
| Type IIIModel=DS-Qwen-2.5-7B2026.04 | 52.92 | 194.5 | 70.38 | |
| Type IIModel=DS-Qwen-2.5-7B2026.04 | 51.25 | 312.1 | 52.46 | |
| No pruning (Baseline)Model=DS-Qwen-2.5-7B2026.04 | 50.99 | 656.6 | — | |
| Type IModel=DS-Qwen-2.5-7B2026.04 | 50 | 199.3 | 69.64 | |
| Type IV (STOP)Model=DS-Qwen-2.5-1.5B2026.04 | 33.75 | 204.4 | 73.61 | |
| Type IIModel=DS-Qwen-2.5-1.5B2026.04 | 31.67 | 325.6 | 57.96 | |
| Type IIIModel=DS-Qwen-2.5-1.5B2026.04 | 31.67 | 209.7 | 72.93 | |
| No pruning (Baseline)Model=DS-Qwen-2.5-1.5B2026.04 | 30.99 | 774.6 | — | |
| Type IModel=DS-Qwen-2.5-1.5B2026.04 | 29.58 | 212.8 | 72.53 |