Mathematical Reasoning on Math Benchmarks (GSM8K, MATH, AMC23, AIME24) (test)
96Accuracy (GSM8K)Standard_p
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Standard_pBackbone=Qwen3-Think-4B2026.02 | 96 | 93 | 99.17 | 82.22 | 92.6 | 1,507.94 | 5,573.16 | 10,956.53 | 21,009.29 | 9,761.73 | — | |
| S3-CoTscBackbone=Qwen3-Think-4B2026.02 | 95 | 92 | 98.33 | 76.67 | 90.5 | 1,061.49 | 4,249.95 | 9,162.59 | 17,308.79 | 7,945.71 | -0.54 | |
| S3-CoTBackbone=Qwen3-Think-4B2026.02 | 94.83 | 92.33 | 100 | 76.67 | 90.96 | 1,029.56 | 4,102.99 | 9,180.6 | 17,284.1 | 7,899.31 | -0.41 | |
| Efficient_pBackbone=Qwen3-Think-4B2026.02 | 94.33 | 91.33 | 96.67 | 76.67 | 89.75 | 812.05 | 4,150.17 | 9,344.19 | 18,074.15 | 8,095.14 | -0.76 | |
| S3-CoTBackbone=LLaMA3-8B2026.02 | 80.17 | 50.33 | 25 | 4.44 | 39.99 | 179.42 | 445.3 | 734.82 | 898.33 | 564.47 | 0.59 | |
| S3-CoTscBackbone=LLaMA3-8B2026.02 | 79.67 | 49.33 | 22.5 | 4.44 | 38.99 | 176.11 | 496.3 | 699.45 | 1,036.81 | 602.17 | 0.41 | |
| Standard_pBackbone=LLaMA3-8B2026.02 | 78.83 | 47.67 | 20 | 3.33 | 37.46 | 245.06 | 605.28 | 857.21 | 1,314.42 | 755.49 | — | |
| Efficient_pBackbone=LLaMA3-8B2026.02 | 68.67 | 43 | 24.17 | 3.33 | 34.79 | 109.61 | 422.35 | 708.14 | 937.38 | 544.37 | -0.43 |