# Mathematical Reasoning on AIME 24 (MV/WMV Acc, Tokens) Source: [Mathematical Reasoning on AIME 24 (MV/WMV Acc, Tokens)]() Collection index: [llms.txt]() Data updated: 2026-07-01T08:01:56.419Z Evaluation of model performance on the AIME 2024 dataset for mathematical reasoning, reporting Mean Value Accuracy (MV), Weighted Mean Value Accuracy (WMV), and the number of Required Tokens. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | AIME 24 | | Metric | Accuracy (MV) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 9 of 9 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy (MV)](): Higher is better; unit: PERCENT. - [Accuracy (WMV)](): Higher is better; unit: PERCENT. - [Required Tokens](): Lower is better; unit: SCALAR. ## Recorded results | Method | Accuracy (MV) | Result date | Report paper | | --- | --- | --- | --- | | DeepConf | 89.2 | Not recorded | 6a449f12e0224bd4f49930df | | ASC | 86 | Not recorded | 6a449f12e0224bd4f49930df | | Flex-Fork-think | 86 | Not recorded | 6a449f12e0224bd4f49930df | | DeepConf | 81.8 | Not recorded | 6a449f12e0224bd4f49930df | | Flex-Fork-think | 81.8 | Not recorded | 6a449f12e0224bd4f49930df | | ASC | 80.1 | Not recorded | 6a449f12e0224bd4f49930df | | DeepConf | 80 | Not recorded | 6a449f12e0224bd4f49930df | | ASC | 77.8 | Not recorded | 6a449f12e0224bd4f49930df | | Flex-Fork-think | 77 | Not recorded | 6a449f12e0224bd4f49930df | ### DeepConf Accuracy (MV): 89.2. Result ID: 6a44c97373d097d845bef79c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-8B","branching factor n":"32"}. This record does not assert independent reproduction. ### ASC Accuracy (MV): 86. Result ID: 6a44c97373d097d845bef79b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-8B","branching factor n":"32"}. This record does not assert independent reproduction. ### Flex-Fork-think Accuracy (MV): 86. Result ID: 6a44c97373d097d845bef79d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-8B","branching factor n":"32","seed path length l0":"2,048"}. This record does not assert independent reproduction. ### DeepConf Accuracy (MV): 81.8. Result ID: 6a44c97373d097d845bef799. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B","branching factor n":"32"}. This record does not assert independent reproduction. ### Flex-Fork-think Accuracy (MV): 81.8. Result ID: 6a44c97373d097d845bef79a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B","branching factor n":"32","seed path length l0":"2,048"}. This record does not assert independent reproduction. ### ASC Accuracy (MV): 80.1. Result ID: 6a44c97373d097d845bef798. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B","branching factor n":"32"}. This record does not assert independent reproduction. ### DeepConf Accuracy (MV): 80. Result ID: 6a44c97373d097d845bef79f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Phi-4-RP-14B","branching factor n":"32"}. This record does not assert independent reproduction. ### ASC Accuracy (MV): 77.8. Result ID: 6a44c97373d097d845bef79e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Phi-4-RP-14B","branching factor n":"32"}. This record does not assert independent reproduction. ### Flex-Fork-think Accuracy (MV): 77. Result ID: 6a44c97373d097d845bef7a0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Phi-4-RP-14B","branching factor n":"32","seed path length l0":"2,048"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.