# Mathematical Reasoning on Minerva (Avg@32) Source: [Mathematical Reasoning on Minerva (Avg@32)]() Collection index: [llms.txt]() Data updated: 2026-04-16T08:43:35.549Z Evaluation of model performance on complex mathematical reasoning problems using the Minerva dataset, specifically measured using the Avg@32 metric. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | Minerva | | Metric | Avg@32 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Avg@32](): Higher is better; unit: PERCENT. ## Recorded results | Method | Avg@32 | Result date | Report paper | | --- | --- | --- | --- | | Dr.GRPO | 31.05 | Not recorded | 69e06d377d0172140ec7cca5 | | DSRL | 30.48 | Not recorded | 69e06d377d0172140ec7cca5 | | DSRL | 30.32 | Not recorded | 69e06d377d0172140ec7cca5 | | DAPO | 30.3 | Not recorded | 69e06d377d0172140ec7cca5 | | PPO | 30.3 | Not recorded | 69e06d377d0172140ec7cca5 | | RLOO | 30.27 | Not recorded | 69e06d377d0172140ec7cca5 | | PPO | 30.19 | Not recorded | 69e06d377d0172140ec7cca5 | | GRPO | 30.06 | Not recorded | 69e06d377d0172140ec7cca5 | | GRPO | 29.65 | Not recorded | 69e06d377d0172140ec7cca5 | | RLOO | 29.52 | Not recorded | 69e06d377d0172140ec7cca5 | | Dr.GRPO | 29.22 | Not recorded | 69e06d377d0172140ec7cca5 | | Reinforce++ | 29.19 | Not recorded | 69e06d377d0172140ec7cca5 | | DAPO | 29.08 | Not recorded | 69e06d377d0172140ec7cca5 | | Reinforce++ | 27.3 | Not recorded | 69e06d377d0172140ec7cca5 | | Vanilla | 23.62 | Not recorded | 69e06d377d0172140ec7cca5 | | Vanilla | 22.33 | Not recorded | 69e06d377d0172140ec7cca5 | ### Dr.GRPO Avg@32: 31.05. Result ID: 69e0a0d347f34ce924c9ef56. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### DSRL Avg@32: 30.48. Result ID: 69e0a0d347f34ce924c9ef59. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### DSRL Avg@32: 30.32. Result ID: 69e0a0d347f34ce924c9ef61. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### DAPO Avg@32: 30.3. Result ID: 69e0a0d347f34ce924c9ef57. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### PPO Avg@32: 30.3. Result ID: 69e0a0d347f34ce924c9ef5b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### RLOO Avg@32: 30.27. Result ID: 69e0a0d347f34ce924c9ef55. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### PPO Avg@32: 30.19. Result ID: 69e0a0d347f34ce924c9ef53. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### GRPO Avg@32: 30.06. Result ID: 69e0a0d347f34ce924c9ef58. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### GRPO Avg@32: 29.65. Result ID: 69e0a0d347f34ce924c9ef60. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### RLOO Avg@32: 29.52. Result ID: 69e0a0d347f34ce924c9ef5d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### Dr.GRPO Avg@32: 29.22. Result ID: 69e0a0d347f34ce924c9ef5e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### Reinforce++ Avg@32: 29.19. Result ID: 69e0a0d347f34ce924c9ef5c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### DAPO Avg@32: 29.08. Result ID: 69e0a0d347f34ce924c9ef5f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### Reinforce++ Avg@32: 27.3. Result ID: 69e0a0d347f34ce924c9ef54. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### Vanilla Avg@32: 23.62. Result ID: 69e0a0d347f34ce924c9ef52. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### Vanilla Avg@32: 22.33. Result ID: 69e0a0d347f34ce924c9ef5a. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.