Mathematical Reasoning on MMATH (test)
37.4Ar ScoreQwen2.5-32B-Instruct + LANG
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-32B-Instruct + LANGMetric Type=Acc2026.05 | 37.4 | 37 | 43.5 | 44.1 | 38.5 | 42.5 | 40.5 | 39.8 | 38.2 | 42.7 | 42.8 | 40.9 | 40.6 | — | — | |
| Qwen2.5-32B-Instruct + LC-GRPOMetric Type=Acc2026.05 | 36.7 | 38.2 | 39.5 | 37.4 | 35.4 | 40.3 | 37.9 | 40.3 | 39.1 | 39.9 | 39.3 | 39.6 | 38.6 | — | — | |
| Qwen2.5-32B-InstructMetric Type=Acc2026.05 | 26.8 | 26.6 | 27.9 | 27.1 | 26.7 | 34.7 | 28.3 | 28 | 26.3 | 30.9 | 29.6 | 28.7 | 28.5 | — | — | |
| Qwen2.5-32B-InstructMetric Type=LC2026.05 | 26.2 | 26.1 | 27.9 | 27.1 | 24.6 | 34.7 | 27.8 | 27.6 | 25.8 | 30.8 | 29.6 | 28.4 | 28 | — | — | |
| Qwen2.5-32B-Instruct + Vanilla GRPOMetric Type=Acc2026.05 | 10 | 16.5 | 39.6 | 35.9 | 25 | 39.5 | 27.8 | 29.1 | 1.1 | 20.5 | 18.6 | 17.3 | 23.6 | — | — | |
| Llama3.1-8B-InstructMetric Type=Acc2026.05 | 7.4 | 10 | 13.1 | 9.3 | 11 | 15.2 | 11 | 10.8 | 8.9 | 11.7 | 12.7 | 11 | 11 | — | — | |
| Llama3.1-8B-Instruct + LANGMetric Type=Acc2026.05 | 7.4 | 9.9 | 14.3 | 8.6 | 12.2 | 16.7 | 11.5 | 11.1 | 9.3 | 12.4 | 12.9 | 11.4 | 11.5 | — | — | |
| Llama3.1-8B-InstructMetric Type=LC2026.05 | 7.2 | 9.7 | 13 | 7.9 | 9.3 | 15.2 | 10.4 | 10.8 | 8.4 | 11.2 | 12.4 | 10.7 | 10.5 | — | — | |
| Llama3.1-8B-Instruct + Vanilla GRPOMetric Type=Acc2026.05 | 3.9 | 7 | 6 | 3.5 | 2.6 | 9.7 | 5.5 | 6.2 | 3.3 | 5.5 | 6.9 | 5.5 | 5.5 | — | — | |
| Llama3.1-8B-Instruct + LC-GRPOMetric Type=Acc2026.05 | 3.4 | 8.8 | 6.9 | 8.8 | 6.2 | 5.8 | 6.6 | 7 | 4.9 | 6.2 | 7 | 6.3 | 6.5 | — | — |