Math Reasoning on MMLU-Pro Xmath
75.1FR slc&accPCS
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PCSBackbone=Qwen3-4B-Base, Evaluation Protocol=avg@1 / Zero-shot2026.07 | 75.1 | 76.9 | 98.1 | 77.4 | 78.9 | 97.9 | 68.5 | 72.5 | 96.9 | 65.9 | 70.8 | 95.4 | 67.9 | 70.6 | 96.1 | 71 | |
| SoftLC RLBackbone=Qwen3-4B-Base, Evaluation Protocol=avg@1 / Zero-shot2026.07 | 40.4 | 72.4 | 89.7 | 59.2 | 73.6 | 93.8 | 49.3 | 67.4 | 92.4 | 36.1 | 65.3 | 88.8 | 57.9 | 66.3 | 95 | 48.6 | |
| M-ThinkerBackbone=Qwen3-4B-Base, Evaluation Protocol=avg@1 / Zero-shot2026.07 | 29.6 | 77.7 | 85.4 | 50.1 | 76 | 90.7 | 62.1 | 75.7 | 92.2 | 61 | 73.8 | 92.2 | 59.9 | 71.4 | 92.1 | 52.5 | |
| Prefix ControlBackbone=Qwen3-4B-Base, Evaluation Protocol=avg@1 / Zero-shot2026.07 | 18.8 | 34.6 | 89.9 | 25.4 | 38.7 | 93.3 | 9.9 | 12.8 | 94.6 | 7 | 10.1 | 91.9 | 26.5 | 33.5 | 92.8 | 17.5 | |
| SFTBackbone=Qwen3-4B-Base, Evaluation Protocol=avg@1 / Zero-shot2026.07 | 7.2 | 54.5 | 80.7 | 13.4 | 59.8 | 71.6 | 0.5 | 0.6 | 96.1 | 5.1 | 12.4 | 88 | 19.3 | 46.4 | 90.2 | 9.1 | |
| Qwen3-4BBackbone=Qwen3-4B-Base, Evaluation Protocol=avg@1 / Zero-shot2026.07 | 0 | 67.4 | 19.3 | 0 | 67 | 19.3 | 0 | 63.8 | 18.2 | 0.1 | 63.8 | 20.6 | 0 | 62.4 | 20.3 | 0 | |
| Prompt ControlBackbone=Qwen3-4B-Base, Evaluation Protocol=avg@1 / Zero-shot2026.07 | 0 | 70.4 | 21.6 | 0 | 70 | 22.2 | 0 | 66.8 | 22.6 | 0.2 | 69 | 25.5 | 0 | 58.6 | 23.9 | 0 | |
| Naive RLBackbone=Qwen3-4B-Base, Evaluation Protocol=avg@1 / Zero-shot2026.07 | 0 | 76 | 4.8 | 0 | 78.1 | 3 | 0.1 | 76.2 | 0.5 | 0.1 | 74.4 | 0.8 | 0 | 74.5 | 1.6 | 0.1 |