# Mathematical Reasoning on MATH (Pass@1, AvgToken) Source: [Mathematical Reasoning on MATH (Pass@1, AvgToken)]() Collection index: [llms.txt]() Data updated: 2026-04-23T11:00:30.726Z Evaluation of model performance on the MATH dataset for mathematical reasoning, specifically reporting Pass@1 accuracy and average generation token length. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | MATH | | Metric | Pass@1 Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Pass@1 Accuracy](): Higher is better; unit: PERCENT. - [Average Token Length](): Higher is better; unit: SCALAR. ## Recorded results | Method | Pass@1 Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Eurus-2-7B-PRIME | 78.3 | Not recorded | 69e9a79155a3c32af89f70a5 | | GRPO w/ Skywork-7B | 75.6 | Not recorded | 69e9a79155a3c32af89f70a5 | | GRPO-VPS | 75.6 | Not recorded | 69e9a79155a3c32af89f70a5 | | DrGRPO | 75.5 | Not recorded | 69e9a79155a3c32af89f70a5 | | GRPO | 75.4 | Not recorded | 69e9a79155a3c32af89f70a5 | | GSPO | 75.2 | Not recorded | 69e9a79155a3c32af89f70a5 | | S-GRPO | 74.9 | Not recorded | 69e9a79155a3c32af89f70a5 | | GRPO-VPS | 72.2 | Not recorded | 69e9a79155a3c32af89f70a5 | | GRPO w/ Skywork-1.5B | 71.4 | Not recorded | 69e9a79155a3c32af89f70a5 | | DrGRPO | 70.5 | Not recorded | 69e9a79155a3c32af89f70a5 | | GRPO | 68.8 | Not recorded | 69e9a79155a3c32af89f70a5 | | GSPO | 68 | Not recorded | 69e9a79155a3c32af89f70a5 | | S-GRPO | 67.5 | Not recorded | 69e9a79155a3c32af89f70a5 | | BASE | 31.9 | Not recorded | 69e9a79155a3c32af89f70a5 | | GRPO-VPS | 31.6 | Not recorded | 69e9a79155a3c32af89f70a5 | | GRPO | 31 | Not recorded | 69e9a79155a3c32af89f70a5 | | BASE | 22.6 | Not recorded | 69e9a79155a3c32af89f70a5 | | BASE | 21.3 | Not recorded | 69e9a79155a3c32af89f70a5 | ### Eurus-2-7B-PRIME Pass@1 Accuracy: 78.3. Result ID: 69e9fbb147f34ce924d20997. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Supervision Type":"With Process Supervision"}. This record does not assert independent reproduction. ### GRPO w/ Skywork-7B Pass@1 Accuracy: 75.6. Result ID: 69e9fbb147f34ce924d20998. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Supervision Type":"With Process Supervision"}. This record does not assert independent reproduction. ### GRPO-VPS Pass@1 Accuracy: 75.6. Result ID: 69e9fbb147f34ce924d2099a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Supervision Type":"With Process Supervision"}. This record does not assert independent reproduction. ### DrGRPO Pass@1 Accuracy: 75.5. Result ID: 69e9fbb147f34ce924d20995. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Supervision Type":"Outcome Supervision Only"}. This record does not assert independent reproduction. ### GRPO Pass@1 Accuracy: 75.4. Result ID: 69e9fbb147f34ce924d20994. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Supervision Type":"Outcome Supervision Only"}. This record does not assert independent reproduction. ### GSPO Pass@1 Accuracy: 75.2. Result ID: 69e9fbb147f34ce924d20996. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Supervision Type":"Outcome Supervision Only"}. This record does not assert independent reproduction. ### S-GRPO Pass@1 Accuracy: 74.9. Result ID: 69e9fbb147f34ce924d20999. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Supervision Type":"With Process Supervision"}. This record does not assert independent reproduction. ### GRPO-VPS Pass@1 Accuracy: 72.2. Result ID: 69e9fbb147f34ce924d20992. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-1.5B","Supervision Type":"With Process Supervision"}. This record does not assert independent reproduction. ### GRPO w/ Skywork-1.5B Pass@1 Accuracy: 71.4. Result ID: 69e9fbb147f34ce924d20990. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-1.5B","Supervision Type":"With Process Supervision"}. This record does not assert independent reproduction. ### DrGRPO Pass@1 Accuracy: 70.5. Result ID: 69e9fbb147f34ce924d2098e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-1.5B","Supervision Type":"Outcome Supervision Only"}. This record does not assert independent reproduction. ### GRPO Pass@1 Accuracy: 68.8. Result ID: 69e9fbb147f34ce924d2098d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-1.5B","Supervision Type":"Outcome Supervision Only"}. This record does not assert independent reproduction. ### GSPO Pass@1 Accuracy: 68. Result ID: 69e9fbb147f34ce924d2098f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-1.5B","Supervision Type":"Outcome Supervision Only"}. This record does not assert independent reproduction. ### S-GRPO Pass@1 Accuracy: 67.5. Result ID: 69e9fbb147f34ce924d20991. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-1.5B","Supervision Type":"With Process Supervision"}. This record does not assert independent reproduction. ### BASE Pass@1 Accuracy: 31.9. Result ID: 69e9fbb147f34ce924d20993. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-7B","Supervision Type":"Outcome Supervision Only"}. This record does not assert independent reproduction. ### GRPO-VPS Pass@1 Accuracy: 31.6. Result ID: 69e9fbb147f34ce924d2099d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Gemma-2-2B-it"}. This record does not assert independent reproduction. ### GRPO Pass@1 Accuracy: 31. Result ID: 69e9fbb147f34ce924d2099c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Gemma-2-2B-it"}. This record does not assert independent reproduction. ### BASE Pass@1 Accuracy: 22.6. Result ID: 69e9fbb147f34ce924d2098c. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math-1.5B","Supervision Type":"Outcome Supervision Only"}. This record does not assert independent reproduction. ### BASE Pass@1 Accuracy: 21.3. Result ID: 69e9fbb147f34ce924d2099b. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Gemma-2-2B-it"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.