# Mathematical Reasoning on OlympiadBench (Avg@32) Source: [Mathematical Reasoning on OlympiadBench (Avg@32)]() Collection index: [llms.txt]() Data updated: 2026-04-16T08:43:35.578Z Evaluation of model performance on mathematical reasoning problems using the OlympiadBench dataset, specifically measured by the Avg@32 metric. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | OlympiadBench | | Metric | Avg@32 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Avg@32](): Higher is better; unit: PERCENT. ## Recorded results | Method | Avg@32 | Result date | Report paper | | --- | --- | --- | --- | | DSRL | 41.82 | Not recorded | 69e06d377d0172140ec7cca5 | | PPO | 41.45 | Not recorded | 69e06d377d0172140ec7cca5 | | DSRL | 41.26 | Not recorded | 69e06d377d0172140ec7cca5 | | GRPO | 40.97 | Not recorded | 69e06d377d0172140ec7cca5 | | Dr.GRPO | 40.75 | Not recorded | 69e06d377d0172140ec7cca5 | | DAPO | 40.71 | Not recorded | 69e06d377d0172140ec7cca5 | | RLOO | 40.65 | Not recorded | 69e06d377d0172140ec7cca5 | | PPO | 40.52 | Not recorded | 69e06d377d0172140ec7cca5 | | RLOO | 40.46 | Not recorded | 69e06d377d0172140ec7cca5 | | Dr.GRPO | 40.45 | Not recorded | 69e06d377d0172140ec7cca5 | | GRPO | 40.29 | Not recorded | 69e06d377d0172140ec7cca5 | | DAPO | 40.28 | Not recorded | 69e06d377d0172140ec7cca5 | | Reinforce++ | 39.52 | Not recorded | 69e06d377d0172140ec7cca5 | | Reinforce++ | 38.15 | Not recorded | 69e06d377d0172140ec7cca5 | | Vanilla | 32.61 | Not recorded | 69e06d377d0172140ec7cca5 | | Vanilla | 32.33 | Not recorded | 69e06d377d0172140ec7cca5 | ### DSRL Avg@32: 41.82. Result ID: 69e0a0d347f34ce924c9ef71. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### PPO Avg@32: 41.45. Result ID: 69e0a0d347f34ce924c9ef6b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### DSRL Avg@32: 41.26. Result ID: 69e0a0d347f34ce924c9ef69. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### GRPO Avg@32: 40.97. Result ID: 69e0a0d347f34ce924c9ef70. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### Dr.GRPO Avg@32: 40.75. Result ID: 69e0a0d347f34ce924c9ef66. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### DAPO Avg@32: 40.71. Result ID: 69e0a0d347f34ce924c9ef6f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### RLOO Avg@32: 40.65. Result ID: 69e0a0d347f34ce924c9ef6d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### PPO Avg@32: 40.52. Result ID: 69e0a0d347f34ce924c9ef63. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### RLOO Avg@32: 40.46. Result ID: 69e0a0d347f34ce924c9ef65. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### Dr.GRPO Avg@32: 40.45. Result ID: 69e0a0d347f34ce924c9ef6e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### GRPO Avg@32: 40.29. Result ID: 69e0a0d347f34ce924c9ef68. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### DAPO Avg@32: 40.28. Result ID: 69e0a0d347f34ce924c9ef67. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### Reinforce++ Avg@32: 39.52. Result ID: 69e0a0d347f34ce924c9ef6c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### Reinforce++ Avg@32: 38.15. Result ID: 69e0a0d347f34ce924c9ef64. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### Vanilla Avg@32: 32.61. Result ID: 69e0a0d347f34ce924c9ef6a. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### Vanilla Avg@32: 32.33. Result ID: 69e0a0d347f34ce924c9ef62. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.