# Mathematical Reasoning on AIME 24 (Peak Accuracy) Source: [Mathematical Reasoning on AIME 24 (Peak Accuracy)]() Collection index: [llms.txt]() Data updated: 2026-05-27T08:40:39.339Z Evaluation of model performance on the AIME 2024 dataset for mathematical reasoning, reporting the Peak Accuracy metric. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | AIME 24 | | Metric | Peak Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Peak Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Peak Accuracy | Result date | Report paper | | --- | --- | --- | --- | | 14B-DAPO | 37.3 | Not recorded | 6a167a79dbd7150506f7fed0 | | 14B-PC | 37.1 | Not recorded | 6a167a79dbd7150506f7fed0 | | 14B-GRPO | 31.1 | Not recorded | 6a167a79dbd7150506f7fed0 | | 8B-GRPO | 27.6 | Not recorded | 6a167a79dbd7150506f7fed0 | | 8B-DAPO | 26.5 | Not recorded | 6a167a79dbd7150506f7fed0 | | 8B-PC | 26.2 | Not recorded | 6a167a79dbd7150506f7fed0 | | 4B-PC | 24.3 | Not recorded | 6a167a79dbd7150506f7fed0 | | 4B-DAPO | 23.5 | Not recorded | 6a167a79dbd7150506f7fed0 | | 4B-GRPO | 20.4 | Not recorded | 6a167a79dbd7150506f7fed0 | | 1.5B-PC | 17.1 | Not recorded | 6a167a79dbd7150506f7fed0 | | 1.5B-DAPO | 17 | Not recorded | 6a167a79dbd7150506f7fed0 | | 1.5B-GRPO | 16.6 | Not recorded | 6a167a79dbd7150506f7fed0 | ### 14B-DAPO Peak Accuracy: 37.3. Result ID: 6a16ace4fbc373592c0fd8c5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"14B","RL Algorithm":"DAPO","Rollouts Trained":"2,048","Rollouts Sampled":"6,144"}. This record does not assert independent reproduction. ### 14B-PC Peak Accuracy: 37.1. Result ID: 6a16ace4fbc373592c0fd8c6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"14B","RL Algorithm":"PC","Rollouts Trained":"2,048","Rollouts Sampled":"4,096"}. This record does not assert independent reproduction. ### 14B-GRPO Peak Accuracy: 31.1. Result ID: 6a16ace4fbc373592c0fd8c4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Scale":"14B","RL Algorithm":"GRPO","Rollouts Trained":"2,048","Rollouts Sampled":"2,048"}. This record does not assert independent reproduction. ### 8B-GRPO Peak Accuracy: 27.6. Result ID: 6a16ace4fbc373592c0fd8c1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Scale":"8B","RL Algorithm":"GRPO","Rollouts Trained":"2,048","Rollouts Sampled":"2,048"}. This record does not assert independent reproduction. ### 8B-DAPO Peak Accuracy: 26.5. Result ID: 6a16ace4fbc373592c0fd8c2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"8B","RL Algorithm":"DAPO","Rollouts Trained":"2,048","Rollouts Sampled":"6,144"}. This record does not assert independent reproduction. ### 8B-PC Peak Accuracy: 26.2. Result ID: 6a16ace4fbc373592c0fd8c3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"8B","RL Algorithm":"PC","Rollouts Trained":"2,048","Rollouts Sampled":"4,096"}. This record does not assert independent reproduction. ### 4B-PC Peak Accuracy: 24.3. Result ID: 6a16ace4fbc373592c0fd8c0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"4B","RL Algorithm":"PC","Rollouts Trained":"2,048","Rollouts Sampled":"4,096"}. This record does not assert independent reproduction. ### 4B-DAPO Peak Accuracy: 23.5. Result ID: 6a16ace4fbc373592c0fd8bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"4B","RL Algorithm":"DAPO","Rollouts Trained":"2,048","Rollouts Sampled":"6,144"}. This record does not assert independent reproduction. ### 4B-GRPO Peak Accuracy: 20.4. Result ID: 6a16ace4fbc373592c0fd8be. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Scale":"4B","RL Algorithm":"GRPO","Rollouts Trained":"2,048","Rollouts Sampled":"2,048"}. This record does not assert independent reproduction. ### 1.5B-PC Peak Accuracy: 17.1. Result ID: 6a16ace4fbc373592c0fd8bd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"1.5B","RL Algorithm":"PC","Rollouts Trained":"2,048","Rollouts Sampled":"4,096"}. This record does not assert independent reproduction. ### 1.5B-DAPO Peak Accuracy: 17. Result ID: 6a16ace4fbc373592c0fd8bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"1.5B","RL Algorithm":"DAPO","Rollouts Trained":"2,048","Rollouts Sampled":"6,144"}. This record does not assert independent reproduction. ### 1.5B-GRPO Peak Accuracy: 16.6. Result ID: 6a16ace4fbc373592c0fd8bb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Scale":"1.5B","RL Algorithm":"GRPO","Rollouts Trained":"2,048","Rollouts Sampled":"2,048"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.