# Mathematical Reasoning on AIME24 (Pass@1 Avg@16) Source: [Mathematical Reasoning on AIME24 (Pass@1 Avg@16)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:57:32.031Z Evaluation of model performance on the AIME 2024 dataset for mathematical reasoning, reporting results using Pass@1 averaged over 16 samples, average token usage, and AE Score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | AIME24 | | Metric | Pass@1 (Avg@16) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Pass@1 (Avg@16)](): Higher is better; unit: PERCENT. - [Avg Tokens](): Lower is better; unit: SCALAR. - [AE Score](): Higher is better; unit: SCALAR. ## Recorded results | Method | Pass@1 (Avg@16) | Result date | Report paper | | --- | --- | --- | --- | | DLER-R1-7B-Research | 51.3 | Not recorded | 6981817ba8b01e76cc8e2572 | | Laser-DE-L4096-7B | 47.7 | Not recorded | 6981817ba8b01e76cc8e2572 | | AdaptThink-7B-delta0.05 | 45.6 | Not recorded | 6981817ba8b01e76cc8e2572 | | SB DS7B alpha 2 | 45.4 | Not recorded | 6981817ba8b01e76cc8e2572 | | L1-Qwen-7B-Max | 44.8 | Not recorded | 6981817ba8b01e76cc8e2572 | | APR-7B (Ours) | 44 | Not recorded | 6981817ba8b01e76cc8e2572 | | TrainingEfficient DS-7B | 42.1 | Not recorded | 6981817ba8b01e76cc8e2572 | | Original Model | 37.7 | Not recorded | 6981817ba8b01e76cc8e2572 | | DLER-R1-1.5B-Research | 32.1 | Not recorded | 6981817ba8b01e76cc8e2572 | | DS-1.5B-thinkprune-iter2k | 30 | Not recorded | 6981817ba8b01e76cc8e2572 | | TrainingEfficient DS-1.5B | 29.2 | Not recorded | 6981817ba8b01e76cc8e2572 | | APR-1.5B (Ours) | 29 | Not recorded | 6981817ba8b01e76cc8e2572 | | L1-Qwen-1.5B-Max | 28.8 | Not recorded | 6981817ba8b01e76cc8e2572 | | Laser-L8192-1.5B | 27.3 | Not recorded | 6981817ba8b01e76cc8e2572 | | AdaptThink-1.5B-delta0.05 | 26.2 | Not recorded | 6981817ba8b01e76cc8e2572 | | Laser-DE-L4096-1.5B | 25.6 | Not recorded | 6981817ba8b01e76cc8e2572 | | Original Model | 19.2 | Not recorded | 6981817ba8b01e76cc8e2572 | ### DLER-R1-7B-Research Pass@1 (Avg@16): 51.3. Result ID: 699659a05698665ec49f1b52. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-7B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### Laser-DE-L4096-7B Pass@1 (Avg@16): 47.7. Result ID: 699659a05698665ec49f1b51. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-7B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### AdaptThink-7B-delta0.05 Pass@1 (Avg@16): 45.6. Result ID: 699659a05698665ec49f1b4d. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-7B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### SB DS7B alpha 2 Pass@1 (Avg@16): 45.4. Result ID: 699659a05698665ec49f1b50. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-7B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### L1-Qwen-7B-Max Pass@1 (Avg@16): 44.8. Result ID: 699659a05698665ec49f1b4e. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-7B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### APR-7B (Ours) Pass@1 (Avg@16): 44. Result ID: 699659a05698665ec49f1b53. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-7B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### TrainingEfficient DS-7B Pass@1 (Avg@16): 42.1. Result ID: 699659a05698665ec49f1b4f. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-7B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### Original Model Pass@1 (Avg@16): 37.7. Result ID: 699659a05698665ec49f1b4c. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-7B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### DLER-R1-1.5B-Research Pass@1 (Avg@16): 32.1. Result ID: 699659a05698665ec49f1b4a. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-1.5B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### DS-1.5B-thinkprune-iter2k Pass@1 (Avg@16): 30. Result ID: 699659a05698665ec49f1b47. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-1.5B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### TrainingEfficient DS-1.5B Pass@1 (Avg@16): 29.2. Result ID: 699659a05698665ec49f1b46. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-1.5B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### APR-1.5B (Ours) Pass@1 (Avg@16): 29. Result ID: 699659a05698665ec49f1b4b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-1.5B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### L1-Qwen-1.5B-Max Pass@1 (Avg@16): 28.8. Result ID: 699659a05698665ec49f1b45. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-1.5B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### Laser-L8192-1.5B Pass@1 (Avg@16): 27.3. Result ID: 699659a05698665ec49f1b48. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-1.5B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### AdaptThink-1.5B-delta0.05 Pass@1 (Avg@16): 26.2. Result ID: 699659a05698665ec49f1b44. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-1.5B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### Laser-DE-L4096-1.5B Pass@1 (Avg@16): 25.6. Result ID: 699659a05698665ec49f1b49. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-1.5B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. ### Original Model Pass@1 (Avg@16): 19.2. Result ID: 699659a05698665ec49f1b43. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-R1-Distill-Qwen-1.5B","Sampling Temperature":0.6,"Max Response Length":8192,"Rollout samples":16}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.