Mathematical Reasoning on AIME 2024 (Accuracy and Token Usage)
79.3AccuracyThoughtFold
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ThoughtFoldModel=Qwen3-14B2026.06 | 79.3 | 8,869 | |
| ThoughtFoldModel=Qwen3-8B2026.06 | 78.1 | 9,099 | |
| S-GRPOModel=Qwen3-14B2026.06 | 77.9 | 8,932 | |
| CoT-SCBackbone=Qwen3-4B2025.09 | 77.78 | 38,140.92 | |
| CoT-SCBackbone=Qwen3-8B2025.09 | 77.78 | 41,127.48 | |
| CoTBackbone=Qwen3-14B2025.09 | 77.78 | 9,685.22 | |
| GRPOModel=Qwen3-14B2026.06 | 77.7 | 14,544 | |
| S-GRPOModel=Qwen3-8B2026.06 | 77.3 | 8,810 | |
| DEERModel=Qwen3-14B2026.04 | 76.7 | 7,619 | |
| DEERModel=Qwen3-32B2026.04 | 76.7 | 8,682 | |
| DEERModel=Qwen3-14B2026.04 | 76.7 | 7,619 | |
| DEERModel=Qwen3-32B2026.04 | 76.7 | 8,682 | |
| VanillaModel=Qwen3-14B2026.06 | 75.4 | 14,116 | |
| Short-RLModel=Qwen3-14B2026.06 | 75.2 | 9,255 | |
| VanillaModel=Qwen3-8B2026.06 | 75.1 | 15,425 | |
| RL + Length PenaltyModel=Qwen3-14B2026.06 | 74.8 | 9,056 | |
| CoT-SCBackbone=Qwen3-14B2025.09 | 74.07 | 36,955.67 | |
| GRPOModel=Qwen3-8B2026.06 | 74 | 15,061 | |
| RL + Length PenaltyModel=Qwen3-8B2026.06 | 73.8 | 9,666 | |
| COTModel=Qwen3-14B2026.04 | 73.3 | 11,742 | |
| SATModel=Qwen3-14B2026.04 | 73.3 | 9,626 | |
| COTModel=Qwen3-14B2026.04 | 73.3 | 11,742 | |
| SATModel=Qwen3-14B2026.04 | 73.3 | 9,626 | |
| ReLATModel=Qwen3-8B2026.06 | 73.3 | — | |
| Short-RLModel=Qwen3-8B2026.06 | 73 | 9,972 | |
| TALEModel=Qwen3-14B2026.04 | 71.1 | 10,860 | |
| CGRSModel=Qwen3-14B2026.04 | 70 | 8,662 | |
| COTModel=Qwen3-32B2026.04 | 70 | 10,788 | |
| SATModel=Qwen3-32B2026.04 | 70 | 9,183 | |
| DEERModel=QwQ-32B2026.04 | 70 | 10,097 | |
| SATModel=QwQ-32B2026.04 | 70 | 9,181 | |
| CGRSModel=Qwen3-14B2026.04 | 70 | 8,662 | |
| COTModel=Qwen3-32B2026.04 | 70 | 10,788 | |
| SATModel=Qwen3-32B2026.04 | 70 | 9,183 | |
| DEERModel=QwQ-32B2026.04 | 70 | 10,097 | |
| SATModel=QwQ-32B2026.04 | 70 | 9,181 | |
| ReLATModel=Qwen3-14B2026.06 | 70 | — | |
| TALEModel=Qwen3-8B2026.04 | 68.9 | 10,942 | |
| CGRSModel=QwQ-32B2026.04 | 68.9 | 8,202 | |
| CGRSModel=QwQ-32B2026.04 | 68.9 | 8,202 | |
| DEERModel=DS-Qwen-14B2026.04 | 68.4 | 8,115 | |
| DEERModel=DS-Qwen-14B2026.04 | 68.4 | 8,115 | |
| Qwen3 + DAPO + Hidden-AlignSize=14B2026.06 | 68.12 | — | |
| TALEModel=Qwen3-32B2026.04 | 67.8 | 10,688 | |
| COTModel=Qwen3-8B2026.04 | 66.7 | 12,393 | |
| SATModel=Qwen3-8B2026.04 | 66.7 | 9,674 | |
| DEERModel=Nemo-Llama-8b2026.04 | 66.7 | 9,755 | |
| COTModel=QwQ-32B2026.04 | 66.7 | 11,305 | |
| COTModel=Qwen3-8B2026.04 | 66.7 | 12,393 | |
| SATModel=Qwen3-8B2026.04 | 66.7 | 9,674 | |
| DEERModel=Nemo-Llama-8b2026.04 | 66.7 | 9,755 | |
| COTModel=QwQ-32B2026.04 | 66.7 | 11,305 | |
| LatentMASModel=Qwen3-14B2026.06 | 66.7 | — | |
| RoTBackbone=Qwen3-4B2025.09 | 66.67 | 10,621.33 | |
| RoTBackbone=Qwen3-8B2025.09 | 66.67 | 11,561.92 | |
| RAGBackbone=Qwen3-14B2025.09 | 66.67 | 10,981.38 | |
| RoTBackbone=Qwen3-14B2025.09 | 66.67 | 11,078.44 | |
| GRPOModel=DeepSeek-R1-Distill-Qwen-14B2026.06 | 65.8 | 13,504 | |
| DynasorModel=Qwen3-14B2026.04 | 65.6 | 9,775 | |
| CGRSModel=Qwen3-32B2026.04 | 65.6 | 8,128 | |
| CGRSModel=Qwen3-32B2026.04 | 65.6 | 8,128 | |
| ThoughtFoldModel=DeepSeek-R1-Distill-Qwen-14B2026.06 | 65.6 | 6,465 | |
| DynasorModel=Qwen3-32B2026.04 | 64.4 | 9,518 | |
| DynasorModel=QwQ-32B2026.04 | 64.4 | 9,733 | |
| VanillaModel=DeepSeek-R1-Distill-Qwen-14B2026.06 | 64.4 | 11,099 | |
| S-GRPOModel=DeepSeek-R1-Distill-Qwen-14B2026.06 | 64.4 | 6,712 | |
| DEERModel=Qwen3-4B2026.04 | 63.3 | 9,327 | |
| DEERModel=Qwen3-4B2026.04 | 63.3 | 9,327 | |
| ReLATModel=Qwen3-4B2026.06 | 63.3 | — | |
| SingleModel=Qwen3-14B2026.06 | 63.3 | — | |
| TextMASModel=Qwen3-14B2026.06 | 63.3 | — | |
| MERABackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.08 | 63.3 | 6,695 | |
| RAGBackbone=Qwen3-4B2025.09 | 62.96 | 10,335.7 | |
| RoT + TIBackbone=Qwen3-4B2025.09 | 62.96 | 9,481.59 | |
| CoTBackbone=Qwen3-8B2025.09 | 62.96 | 11,232.55 | |
| RoT + TIBackbone=Qwen3-14B2025.09 | 62.96 | 11,201.03 | |
| DynasorModel=Qwen3-8B2026.04 | 62.2 | 10,174 | |
| NoThinkingModel=QwQ-32B2026.04 | 62.2 | 11,688 | |
| DEERModel=Qwen3-8B2026.04 | 61.7 | 8,796 | |
| DEERModel=Qwen3-8B2026.04 | 61.7 | 8,796 | |
| Short-RLModel=DeepSeek-R1-Distill-Qwen-14B2026.06 | 61.7 | 7,561 | |
| CGRSModel=Qwen3-8B2026.04 | 61.1 | 8,792 | |
| TALEModel=QwQ-32B2026.04 | 61.1 | 10,888 | |
| CGRSModel=Qwen3-8B2026.04 | 61.1 | 8,792 | |
| Qwen3 + DAPOSize=14B2026.06 | 60.94 | — | |
| DEERBackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.08 | 60.7 | 8,388 | |
| OriginalBackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.08 | 60.6 | 11,155 | |
| ThinkSwitcherModel=DS-Qwen-14B2026.04 | 60.4 | 8,044 | |
| ThinkSwitcherModel=DS-Qwen-14B2026.04 | 60.4 | 8,044 | |
| COTModel=Qwen3-4B2026.04 | 60 | 12,662 | |
| SATModel=Qwen3-4B2026.04 | 60 | 9,462 | |
| COTModel=DS-Qwen-14B2026.04 | 60 | 10,343 | |
| SATModel=DS-Qwen-14B2026.04 | 60 | 8,393 | |
| SATModel=Nemo-Llama-8b2026.04 | 60 | 9,258 | |
| COTModel=Qwen3-4B2026.04 | 60 | 12,662 | |
| SATModel=Qwen3-4B2026.04 | 60 | 9,462 | |
| COTModel=DS-Qwen-14B2026.04 | 60 | 10,343 | |
| SATModel=DS-Qwen-14B2026.04 | 60 | 8,393 | |
| SATModel=Nemo-Llama-8b2026.04 | 60 | 9,258 | |
| RoT + TIBackbone=Qwen3-8B2025.09 | 59.26 | 10,930.03 |