Mathematical Reasoning on (MATH500, AMC12, AIME24, AIME25, HMMT25) (test)
86MATH500 ScoreFailure-Prefix
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Failure-PrefixIteration=Iteration 2, Maximum token length=32000, Temperature=0.6, Top-p=1, Number of rollouts per question=322026.01 | 86 | 58.3 | 34.7 | 25.7 | 15.6 | 44 | |
| Failure-PrefixCheckpoint=400, Maximum token length=32000, Temperature=0.6, Top-p=1, Number of rollouts per question=322026.01 | 85.7 | 56.3 | 33 | 25.9 | 16.2 | 43.4 | |
| Failure-PrefixIteration=Extended Iteration 1, Maximum token length=32000, Temperature=0.6, Top-p=1, Number of rollouts per question=322026.01 | 85.1 | 56.3 | 33.4 | 25.5 | 16.5 | 43.4 | |
| MediumMaximum token length=32000, Temperature=0.6, Top-p=1, Number of rollouts per question=322026.01 | 85 | 57.8 | 32 | 26.2 | 15 | 43.2 | |
| SaturateMaximum token length=32000, Temperature=0.6, Top-p=1, Number of rollouts per question=322026.01 | 84.2 | 51.7 | 30 | 24 | 13.5 | 40.7 | |
| BaseMaximum token length=32000, Temperature=0.6, Top-p=1, Number of rollouts per question=322026.01 | 83.5 | 53.1 | 28.4 | 24 | 14.2 | 40.6 |