Mathematical Reasoning on NuminaMath (Accuracy, Delta Metrics)
62.45Math AccuracyCKA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CKAPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 62.45 | -11.04 | -15 | |
| RandomPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 56.83 | -16.66 | -22.7 | |
| Ours-NonMathPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 55.5 | -17.99 | -24.5 | |
| Ours-MixedPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 54.42 | -19.07 | -25.9 | |
| Ours-MathPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 52.41 | -21.08 | -28.7 | |
| InterlacePruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 47.99 | -25.5 | -34.7 | |
| Ours-NonMathPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 28.92 | -44.57 | -60.6 | |
| Ours-MixedPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 28.11 | -45.38 | -61.7 | |
| Ours-MathPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 25.7 | -47.79 | -65 | |
| InterlacePruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 22.69 | -50.8 | -69.1 | |
| RandomPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 22.29 | -51.2 | -69.7 | |
| CKAPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 21.89 | -51.6 | -70.2 | |
| InterlacePruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 19.48 | -54.01 | -73.5 | |
| Ours-NonMathPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 13.65 | -59.84 | -81.4 | |
| Ours-MathPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 10.44 | -63.05 | -85.8 | |
| Ours-MixedPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 10.04 | -63.45 | -86.3 | |
| RandomPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 8.23 | -65.26 | -88.8 | |
| CKAPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 6.02 | -67.47 | -91.8 |