Mathematical Reasoning on AIME 2024 (Pass@1, Token Usage)
67.33Pass@1 AccuracyMixReasoning
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MixReasoningType=ADAPTIVE2025.10 | 67.33 | 8,873 | |
| BeConciseType=SHORT COT2025.10 | 66.67 | 11,371 | |
| DEERType=SHORT COT2025.10 | 66.33 | 10,298 | |
| O1-PrunerType=SHORT COT2025.10 | 65.67 | 10,498 | |
| NoWaitType=SHORT COT2025.10 | 64.83 | 9,936 | |
| Qwen3-8BType=BASE LLM2025.10 | 64.67 | 11,975 | |
| CoT-ValveType=SHORT COT2025.10 | 33.33 | 7,412 | |
| ThinklessType=HYBRID2025.10 | 27.33 | 7,099 |