Mathematical Problem Solving on Aggregated Math Benchmarks (MATH, AMC, Minerva, OlympiadBench) (test)
65.6MATH AccuracyGATES
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GATESDecoding Strategy=maj@82026.02 | 65.6 | 26.5 | 21.7 | 27.7 | 35.4 | |
| Tutor-Trajectory SFTDecoding Strategy=maj@82026.02 | 60.8 | 24.1 | 19.5 | 24.7 | 32.3 | |
| Outcome RLDecoding Strategy=maj@82026.02 | 44 | 10.8 | 18.4 | 12 | 21.3 | |
| Base ModelDecoding Strategy=maj@82026.02 | 42.6 | 9.6 | 15.8 | 12.6 | 20.2 | |
| Answer-Only SFT (w/ doc)Decoding Strategy=maj@82026.02 | 35.8 | 10.8 | 14.3 | 7.3 | 17.1 | |
| Answer-Only SFTDecoding Strategy=maj@82026.02 | 35.6 | 8.4 | 13.2 | 7.7 | 16.2 |