# Mathematical Reasoning on AIME 24 (Raw Score) Source: [Mathematical Reasoning on AIME 24 (Raw Score)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:04:01.766Z Evaluation of model performance on the AIME 2024 dataset for mathematical reasoning, measured using the raw 'Score' metric. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | AIME 24 | | Metric | Score | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Score](): Higher is better; unit: SCALAR. - [Last Score](): Higher is better; unit: PERCENT. - [Best Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Score | Result date | Report paper | | --- | --- | --- | --- | | MQR | 25 | Not recorded | 697ae9bca2b28e761d87d165 | | MathForge | 24.58 | Not recorded | 697ae9bca2b28e761d87d165 | | DGPO | 23.85 | Not recorded | 697ae9bca2b28e761d87d165 | | GPG | 21.98 | Not recorded | 697ae9bca2b28e761d87d165 | | GRPO-AD | 21.56 | Not recorded | 697ae9bca2b28e761d87d165 | | DAPO | 21.25 | Not recorded | 697ae9bca2b28e761d87d165 | | Dr.GRPO | 21.04 | Not recorded | 697ae9bca2b28e761d87d165 | | GRPO | 20.94 | Not recorded | 697ae9bca2b28e761d87d165 | | GSPO | 19.38 | Not recorded | 697ae9bca2b28e761d87d165 | | Base Model | 12.19 | Not recorded | 697ae9bca2b28e761d87d165 | ### MQR Score: 25. Result ID: 69961cac5698665ec45cd0be. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### MathForge Score: 24.58. Result ID: 69961cac5698665ec45cd0bf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### DGPO Score: 23.85. Result ID: 69961cac5698665ec45cd0bd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### GPG Score: 21.98. Result ID: 69961cac5698665ec45cd0b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### GRPO-AD Score: 21.56. Result ID: 69961cac5698665ec45cd0bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### DAPO Score: 21.25. Result ID: 69961cac5698665ec45cd0ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### Dr.GRPO Score: 21.04. Result ID: 69961cac5698665ec45cd0b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### GRPO Score: 20.94. Result ID: 69961cac5698665ec45cd0b7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### GSPO Score: 19.38. Result ID: 69961cac5698665ec45cd0bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### Base Model Score: 12.19. Result ID: 69961cac5698665ec45cd0b6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Training Dataset":"MATH","Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.