Mathematical Reasoning on Snapask (Accuracy, Delta Metrics)
40.24AccuracyCKA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CKAPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 40.24 | -10.51 | -20.7 | |
| RandomPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 37.09 | -13.66 | -26.9 | |
| Ours-MathPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 35.83 | -14.92 | -29.4 | |
| Ours-NonMathPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 33.54 | -17.21 | -33.9 | |
| Ours-MixedPruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 33.23 | -17.52 | -34.5 | |
| InterlacePruning Budget=10%, Fine-tuning Protocol=without fine-tuning2026.03 | 28.82 | -21.93 | -43.2 | |
| Ours-MathPruning Budget=10%, Backbone=Qwen3-VL-2B2026.03 | 28.15 | -12.32 | -30.4 | |
| Ours-MixedPruning Budget=10%, Backbone=Qwen3-VL-2B2026.03 | 24.88 | -15.59 | -38.5 | |
| Ours-NonMathPruning Budget=10%, Backbone=Qwen3-VL-2B2026.03 | 24.69 | -15.78 | -39 | |
| InterlacePruning Budget=10%, Backbone=Qwen3-VL-2B2026.03 | 20.75 | -19.72 | -48.7 | |
| Ours-NonMathPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 18.19 | -32.56 | -64.2 | |
| RandomPruning Budget=10%, Backbone=Qwen3-VL-2B2026.03 | 17.09 | -23.38 | -57.8 | |
| Ours-MixedPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 16.26 | -34.49 | -68 | |
| CKAPruning Budget=10%, Backbone=Qwen3-VL-2B2026.03 | 15.98 | -24.49 | -60.5 | |
| Ours-MathPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 15.98 | -34.77 | -68.5 | |
| CKAPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 12.44 | -38.31 | -75.5 | |
| InterlacePruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 12.09 | -38.66 | -76.2 | |
| RandomPruning Budget=25%, Fine-tuning Protocol=without fine-tuning2026.03 | 11.3 | -39.45 | -77.7 | |
| Ours-NonMathPruning Budget=25%, Backbone=Qwen3-VL-2B2026.03 | 11.06 | -29.41 | -72.7 | |
| InterlacePruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 10.79 | -39.96 | -78.7 | |
| Ours-MathPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 9.76 | -40.99 | -80.8 | |
| Ours-MixedPruning Budget=25%, Backbone=Qwen3-VL-2B2026.03 | 9.61 | -30.86 | -76.3 | |
| Ours-MathPruning Budget=25%, Backbone=Qwen3-VL-2B2026.03 | 9.21 | -31.26 | -77.2 | |
| Ours-NonMathPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 9.06 | -41.69 | -82.1 | |
| Ours-MixedPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 7.68 | -43.07 | -84.9 | |
| RandomPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 5.51 | -45.24 | -89.1 | |
| InterlacePruning Budget=25%, Backbone=Qwen3-VL-2B2026.03 | 5.17 | -35.3 | -87.2 | |
| CKAPruning Budget=25%, Backbone=Qwen3-VL-2B2026.03 | 4.8 | -35.67 | -88.1 | |
| RandomPruning Budget=25%, Backbone=Qwen3-VL-2B2026.03 | 4.72 | -35.75 | -88.3 | |
| Ours-MixedPruning Budget=40%, Backbone=Qwen3-VL-2B2026.03 | 4.65 | -35.82 | -88.5 | |
| InterlacePruning Budget=40%, Backbone=Qwen3-VL-2B2026.03 | 4.57 | -35.9 | -88.7 | |
| Ours-NonMathPruning Budget=40%, Backbone=Qwen3-VL-2B2026.03 | 4.06 | -36.41 | -90 | |
| CKAPruning Budget=40%, Fine-tuning Protocol=without fine-tuning2026.03 | 3.7 | -47.05 | -92.7 | |
| Ours-MathPruning Budget=40%, Backbone=Qwen3-VL-2B2026.03 | 3.46 | -37.01 | -91.5 | |
| CKAPruning Budget=40%, Backbone=Qwen3-VL-2B2026.03 | 2.48 | -37.99 | -93.9 | |
| RandomPruning Budget=40%, Backbone=Qwen3-VL-2B2026.03 | 2.44 | -38.03 | -94 |