Mathematical Reasoning on AIME
90Pass@1NSED (High-Perf open-weight)
Evaluation Results
| Method | Links | |
|---|---|---|
| NSED (High-Perf open-weight)Hardware Class=Enterprise, Est. Cost/Sol=High, Model Scale=70B+2026.01 | 90 | |
| DeepSeek-R1 (RL-CoT)Hardware Class=Enterprise, Est. Cost/Sol=Medium2026.01 | 84.2 | |
| NSED (Consumer open-weight)Hardware Class=Consumer, Est. Cost/Sol=Low, Model Scale=<20B2026.01 | 84 | |
| Gemini-2.5-Pro-06-05Hardware Class=Enterprise, Est. Cost/Sol=High2026.01 | 78.3 | |
| Phi-4-mini + Mistral3-3BTraining=CORE2026.01 | 71.42 | |
| Phi-4-mini + Mistral3-3B + OracleTraining=SD-E²2026.01 | 54.42 | |
| Majority Voting (Qwen-8B)Hardware Class=Consumer, Est. Cost/Sol=Low2026.01 | 54 | |
| e3-1.7B + Distill + RLRL Data Size=1216, Evaluation Protocol=8 rollouts avg.2026.01 | 36.67 | |
| e3-1.7B + RLRL Data Size=1216, Evaluation Protocol=8 rollouts avg.2026.01 | 36.25 | |
| e3-1.7B + InT+ RLRL Data Size=64, Evaluation Protocol=8 rollouts avg.2026.01 | 36.25 | |
| Ministral-3-8B-ReasoningTraining=SD-E²2026.01 | 18.5 | |
| Qwen2.5-7B-InstructTraining=SD-E²2026.01 | 16.4 | |
| PersonaHub-MathSFT Dataset=PersonaHub-Math2024.10 | 13.33 | |
| Numina MATHSFT Dataset=Numina MATH2024.10 | 13.33 | |
| MATRIX-Gen-ReasonSFT Dataset=MATRIX-Gen-Reason2024.10 | 13.33 | |
| FPABackbone=Qwen2.5-Math-7B2025.09 | 12.7 | |
| Phi-3-small-8k-InstructTraining=SD-E²2026.01 | 12 | |
| Off-RLBackbone=Qwen2.5-Math-7B2025.09 | 11.8 | |
| DPOBackbone=Qwen2.5-Math-7B2025.09 | 11.6 | |
| KTOBackbone=Qwen2.5-Math-7B2025.09 | 11 | |
| A*-POBackbone=Qwen2.5-Math-7B2025.09 | 10.9 | |
| BaseBackbone=Qwen2.5-Math-7B2025.09 | 10.8 | |
| RPOBackbone=Qwen2.5-Math-7B2025.09 | 10.6 | |
| SFTBackbone=Qwen2.5-Math-7B2025.09 | 10.2 | |
| FPABackbone=Qwen3-4B-Base2025.09 | 10.1 | |
| Tulu 3 CodeSFT Dataset=Tulu 3 Code2024.10 | 10 | |
| DPOBackbone=Qwen3-4B-Base2025.09 | 9.6 | |
| KTOBackbone=Qwen3-4B-Base2025.09 | 8.9 | |
| RPOBackbone=Qwen3-4B-Base2025.09 | 8.5 | |
| Off-RLBackbone=Qwen3-4B-Base2025.09 | 8.5 | |
| A*-POBackbone=Qwen3-4B-Base2025.09 | 7.9 | |
| SFTBackbone=Qwen3-4B-Base2025.09 | 6.7 | |
| Camel MATHSFT Dataset=Camel MATH2024.10 | 6.67 | |
| Magpie ReasonSFT Dataset=Magpie Reason2024.10 | 6.67 | |
| BaseBackbone=Qwen3-4B-Base2025.09 | 6.6 | |
| Tulu 3 MATHSFT Dataset=Tulu 3 MATH2024.10 | 3.33 | |
| BaseBackbone=Llama-3.2-3B-Instruct2025.09 | 2.7 | |
| Off-RLBackbone=Llama-3.2-3B-Instruct2025.09 | 2.3 | |
| SFTBackbone=Llama-3.2-3B-Instruct2025.09 | 2.2 | |
| A*-POBackbone=Llama-3.2-3B-Instruct2025.09 | 2.1 | |
| FPABackbone=Llama-3.2-3B-Instruct2025.09 | 2.1 | |
| KTOBackbone=Llama-3.2-3B-Instruct2025.09 | 2 | |
| DPOBackbone=Llama-3.2-3B-Instruct2025.09 | 1.8 | |
| RPOBackbone=Llama-3.2-3B-Instruct2025.09 | 1.3 |