# Mathematical Reasoning on Aggregate (GSM8K, MATH, DAPO-MATH, AMC23, AIME25) Source: [Mathematical Reasoning on Aggregate (GSM8K, MATH, DAPO-MATH, AMC23, AIME25)]() Collection index: [llms.txt]() Data updated: 2026-05-19T06:18:37.340Z Evaluation of Mathematical Reasoning performance across an aggregate benchmark comprising GSM8K, MATH, DAPO-MATH, AMC23, and AIME25 datasets. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | Mathematical Reasoning Aggregate GSM8K, MATH, DAPO-MATH, AMC23, AIME25 | | Metric | Average Pass@1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Average Pass@1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Average Pass@1 | Result date | Report paper | | --- | --- | --- | --- | | Qwen3-4B | 76.6 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen3-4B | 76.4 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen3-8B | 75.5 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen3-4B | 75 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen3-4B | 74.2 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen3-8B | 71.6 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen2.5-Math-7B | 67.3 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen2.5-Math-7B | 65.5 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen2.5-Math-7B | 60 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen3-1.7B | 58.2 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen2.5-Math-7B | 58.1 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen3-1.7B | 54.8 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen2.5-Math-1.5B | 50.9 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen2.5-Math-1.5B | 48 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen2.5-Math-1.5B | 46.9 | Not recorded | 6a0beebbdbc836b87d82c5bd | | Qwen2.5-Math-1.5B | 46.6 | Not recorded | 6a0beebbdbc836b87d82c5bd | ### Qwen3-4B Average Pass@1: 76.6. Result ID: 6a0bffbd47f34ce924f1cd1a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"DAPO-MATH","Method Variant":"LZE","FLOPs Budget":"5.48 × 10^19"}. This record does not assert independent reproduction. ### Qwen3-4B Average Pass@1: 76.4. Result ID: 6a0bffbd47f34ce924f1cd19. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"DAPO-MATH","Method Variant":"Base","FLOPs Budget":"8.56 × 10^19"}. This record does not assert independent reproduction. ### Qwen3-8B Average Pass@1: 75.5. Result ID: 6a0bffbd47f34ce924f1cd1c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"DAPO-MATH","Method Variant":"LZE","FLOPs Budget":"6.30 × 10^19"}. This record does not assert independent reproduction. ### Qwen3-4B Average Pass@1: 75. Result ID: 6a0bffbd47f34ce924f1cd16. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"MATH","Method Variant":"LZE","FLOPs Budget":"7.55 × 10^19"}. This record does not assert independent reproduction. ### Qwen3-4B Average Pass@1: 74.2. Result ID: 6a0bffbd47f34ce924f1cd15. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"MATH","Method Variant":"Base","FLOPs Budget":"1.18 × 10^20"}. This record does not assert independent reproduction. ### Qwen3-8B Average Pass@1: 71.6. Result ID: 6a0bffbd47f34ce924f1cd1b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"DAPO-MATH","Method Variant":"Base","FLOPs Budget":"9.85 × 10^19"}. This record does not assert independent reproduction. ### Qwen2.5-Math-7B Average Pass@1: 67.3. Result ID: 6a0bffbd47f34ce924f1cd18. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"DAPO-MATH","Method Variant":"LZE","FLOPs Budget":"1.89 × 10^20"}. This record does not assert independent reproduction. ### Qwen2.5-Math-7B Average Pass@1: 65.5. Result ID: 6a0bffbd47f34ce924f1cd17. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"DAPO-MATH","Method Variant":"Base","FLOPs Budget":"2.94 × 10^20"}. This record does not assert independent reproduction. ### Qwen2.5-Math-7B Average Pass@1: 60. Result ID: 6a0bffbd47f34ce924f1cd14. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"MATH","Method Variant":"LZE","FLOPs Budget":"1.09 × 10^20"}. This record does not assert independent reproduction. ### Qwen3-1.7B Average Pass@1: 58.2. Result ID: 6a0bffbd47f34ce924f1cd10. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"GSM8K","Method Variant":"LZE","FLOPs Budget":"3.17 × 10^19"}. This record does not assert independent reproduction. ### Qwen2.5-Math-7B Average Pass@1: 58.1. Result ID: 6a0bffbd47f34ce924f1cd13. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"MATH","Method Variant":"Base","FLOPs Budget":"1.70 × 10^20"}. This record does not assert independent reproduction. ### Qwen3-1.7B Average Pass@1: 54.8. Result ID: 6a0bffbd47f34ce924f1cd0f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"GSM8K","Method Variant":"Base","FLOPs Budget":"4.94 × 10^19"}. This record does not assert independent reproduction. ### Qwen2.5-Math-1.5B Average Pass@1: 50.9. Result ID: 6a0bffbd47f34ce924f1cd12. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"MATH","Method Variant":"LZE","FLOPs Budget":"3.73 × 10^19"}. This record does not assert independent reproduction. ### Qwen2.5-Math-1.5B Average Pass@1: 48. Result ID: 6a0bffbd47f34ce924f1cd0e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"GSM8K","Method Variant":"LZE","FLOPs Budget":"3.50 × 10^19"}. This record does not assert independent reproduction. ### Qwen2.5-Math-1.5B Average Pass@1: 46.9. Result ID: 6a0bffbd47f34ce924f1cd11. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"MATH","Method Variant":"Base","FLOPs Budget":"5.82 × 10^19"}. This record does not assert independent reproduction. ### Qwen2.5-Math-1.5B Average Pass@1: 46.6. Result ID: 6a0bffbd47f34ce924f1cd0d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Training Set":"GSM8K","Method Variant":"Base","FLOPs Budget":"5.47 × 10^19"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.