Mathematical Reasoning on HMMT 2025
97.9AccuracyGLM-5
Evaluation Results
| Method | Links | ||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GLM-5Params=744B2026.06 | 97.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini 3 ProParams=N/A2026.06 | 97.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.6 PlusParams=N/A2026.06 | 96.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Kimi K2.5Params=1T2026.06 | 95.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VibeThinker-3B + CLRParams=3B, Post-training optimization=CLR2026.06 | 95.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VibeThinker-3BParams=3B, CLR reasoning enhancement=true2026.06 | 95.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.5-397B-A17BParams=397B2026.06 | 94.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini 3-Pro2026.02 | 93.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-5 (High)2026.02 | 93.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Claude Opus 4.5Params=N/A2026.06 | 92.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TRICE-30BTool Usage=true, Parameter Scale=~30B, Evaluation Protocol=unified2026.05 | 92.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Nemotron-3-Nano-30B-A3BTool Usage=true, Parameter Scale=~30B, Evaluation Protocol=unified2026.05 | 90.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DeepSeek V3.2Params=671B2026.06 | 90.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-OSS (high)Params=120B2026.06 | 90 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Grok 4Params=N/A2026.06 | 90 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GLM-4.7-Flash w/ recipeTool Usage=true, Parameter Scale=~30B, Evaluation Protocol=unified2026.05 | 89.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VibeThinker-3BParams=3B2026.06 | 89.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VibeThinker-3BParams=3B2026.06 | 89.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-5 (high)Params=N/A2026.06 | 88.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TRICE-4BTool Usage=true, Parameter Scale=<10B, Evaluation Protocol=unified2026.05 | 86.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS V3.2-Thinking2026.02 | 86.67 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.5-35B-A3BTool Usage=false, Parameter Scale=~30B, Evaluation Protocol=unified2026.05 | 85.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DIS-GMM*Model=DeepSeek-R1-8B, Budget=128, Repetitions=64, SelfStepConf=true2026.03 | 84.95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MiMo v2 FlashParams=309B2026.06 | 84.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GLM-4.7-FlashTool Usage=true, Parameter Scale=~30B, Evaluation Protocol=unified2026.05 | 84.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| WSC-GMM*Model=DeepSeek-R1-8B, Budget=128, Repetitions=64, SelfStepConf=true2026.03 | 84.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-235B-A22B-ThinkingParams=235B2026.06 | 83.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LongCat FlashParams=560B2026.06 | 83.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-OSS-20BTool Usage=true, Parameter Scale=~30B, Evaluation Protocol=unified2026.05 | 83.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DC-TailModel=DeepSeek-R1-8B2026.05 | 83.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CDG (ours)Model=DeepSeek-R1-8B2026.05 | 83.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DIS-GMMModel=DeepSeek-R1-8B, Budget=128, Repetitions=64, SelfStepConf=false2026.03 | 82.55 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| WSC-GMMModel=DeepSeek-R1-8B, Budget=128, Repetitions=64, SelfStepConf=false2026.03 | 82.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini 2.5 ProParams=N/A2026.06 | 82.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.5-9BTool Usage=false, Parameter Scale=<10B, Evaluation Protocol=unified2026.05 | 82.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TRICE-30BTool Usage=false, Parameter Scale=~30B, Evaluation Protocol=unified2026.05 | 81.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini 2.5-Pro2026.02 | 81.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ERNIE 5.02026.02 | 79.58 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DeepSeek R1 0528Params=671B2026.06 | 79.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DIS-Top50Model=DeepSeek-R1-8B, Budget=128, Repetitions=642026.03 | 79.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OpenAI o3 (high)Params=N/A2026.06 | 77.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ASTER-4B†Tool Usage=true, Parameter Scale=<10B, Evaluation Protocol=original2026.05 | 77.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MoB-AdaptiveModel=DeepSeek-R1-8B, Budget=128, Repetitions=642026.03 | 76.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| D-CDG (α = 1)Model=DeepSeek-R1-8B2026.05 | 76.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-OSS-20B (high)Params=20B2026.06 | 76.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-30B-A3B-Thinking-2507Tool Usage=false, Parameter Scale=~30B, Evaluation Protocol=unified2026.05 | 75.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-5 Nano (high)Params=N/A2026.06 | 75.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| WSC-Top50Model=DeepSeek-R1-8B, Budget=128, Repetitions=642026.03 | 73.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AgentMath-30B-A3B†Tool Usage=true, Parameter Scale=~30B, Evaluation Protocol=original2026.05 | 73.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.5-4BParams=4B2026.06 | 73.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DC-TailModel=gpt-oss-20B2026.05 | 73.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CDG (ours)Model=gpt-oss-20B2026.05 | 73.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.5-4BTool Usage=false, Parameter Scale=<10B, Evaluation Protocol=unified2026.05 | 72.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TRICE-4BTool Usage=false, Parameter Scale=<10B, Evaluation Protocol=unified2026.05 | 71.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AgentMath-8B†Tool Usage=true, Parameter Scale=<10B, Evaluation Protocol=original2026.05 | 71.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BoNModel=DeepSeek-R1-8B, Budget=128, Repetitions=642026.03 | 70.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MajorityModel=DeepSeek-R1-8B2026.05 | 70 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DC-MeanModel=DeepSeek-R1-8B2026.05 | 70 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| D-CDG (β = 0)Model=DeepSeek-R1-8B2026.05 | 70 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DC-MeanModel=gpt-oss-20B2026.05 | 70 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| D-CDG (α = 1)Model=gpt-oss-20B2026.05 | 70 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| D-CDG (β = 0)Model=gpt-oss-20B2026.05 | 70 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| WSCModel=DeepSeek-R1-8B, Budget=128, Repetitions=642026.03 | 69.69 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GLM-4.5-AirParams=106B2026.06 | 69.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCModel=DeepSeek-R1-8B, Budget=128, Repetitions=642026.03 | 69.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-4B-Thinking-2507Tool Usage=false, Parameter Scale=<10B, Evaluation Protocol=unified2026.05 | 68.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS-R1-Distill-Qwen-7B + IC-DAPOBackbone=Qwen-7B, Zero-shot mode=true, Time/Step (s)=315.62026.03 | 67.8 | 29.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS-R1-Distill-Qwen-7B + CE-GPPOBackbone=Qwen-7B, Zero-shot mode=true, Time/Step (s)=292.52026.03 | 67.3 | 28.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ministral-3-Reasoning-2512Params=14B2026.06 | 67.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MajorityModel=gpt-oss-20B2026.05 | 66.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DIS-GMM*Model=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=false, SelfStepConf=true2026.03 | 65.73 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS-R1-Distill-Qwen-7B + DAPOBackbone=Qwen-7B, Zero-shot mode=true, Time/Step (s)=303.12026.03 | 65.3 | 27.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| WSC-GMM*Model=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=false, SelfStepConf=true2026.03 | 65.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DIS-Top50Model=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=true2026.03 | 64.95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| WSC-GMMModel=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=true2026.03 | 64.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DIS-GMMModel=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=true2026.03 | 64.43 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini 2.5 FlashParams=N/A2026.06 | 64.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| WSC-Top50Model=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=true2026.03 | 63.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MoB-AdaptiveModel=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=true2026.03 | 63.85 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OpenReasoning-NemotronParams=7B2026.06 | 63.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DC-TailModel=QwQ-32B2026.05 | 63.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| D-CDG (α = 1)Model=QwQ-32B2026.05 | 63.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CDG (ours)Model=QwQ-32B2026.05 | 63.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemma-4-itParams=12B2026.06 | 63.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| WSCModel=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=true2026.03 | 62.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCModel=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=true2026.03 | 62.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS-R1-Distill-Qwen-7BBackbone=Qwen-7B, Zero-shot mode=true2026.03 | 61.8 | 26.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS-R1-Distill-Qwen-7B + GRPOBackbone=Qwen-7B, Zero-shot mode=true, Time/Step (s)=305.62026.03 | 61.4 | 24.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pass@1Model=DeepSeek-R1-8B2026.05 | 59.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BoNModel=Qwen3-32B, Budget=128, Repetitions=64, Thinking mode=true2026.03 | 59.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MajorityModel=QwQ-32B2026.05 | 56.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DC-MeanModel=QwQ-32B2026.05 | 56.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| D-CDG (β = 0)Model=QwQ-32B2026.05 | 56.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS-R1-Distill-Qwen-1.5B + IC-DAPOBackbone=Qwen-1.5B, Zero-shot mode=true, Time/Step (s)=477.22026.03 | 56.4 | 19.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-30B-A3B-Instruct-2507Tool Usage=false, Parameter Scale=~30B, Evaluation Protocol=unified2026.05 | 55.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS-R1-Distill-Qwen-1.5B + GSPOBackbone=Qwen-1.5B, Zero-shot mode=true, Time/Step (s)=437.32026.03 | 55.7 | 19 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS-R1-Distill-Qwen-1.5B + CE-GPPOBackbone=Qwen-1.5B, Zero-shot mode=true, Time/Step (s)=464.02026.03 | 55.7 | 20.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-4B-Thinking-2507Params=4B2026.06 | 55.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FullModel=Qwen3-14B, KV Cache Budget=100%2026.06 | 54.79 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DS-R1-Distill-Qwen-1.5B + DAPOBackbone=Qwen-1.5B, Zero-shot mode=true, Time/Step (s)=459.62026.03 | 53.9 | 19.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |