Mathematical Reasoning on BeyondAIME (avg@16)
61.7avg@16ASTER-4B
Evaluation results
| Method | Links | |
|---|---|---|
| ASTER-4BModel Category=Agentic Reasoning Models, Inference Budget=90K2026.02 | 61.7 | |
| THINC-4BReasoning Type=THINC Student2026.05 | 56.1 | |
| Qwen3-235B-A22B-ThinkingReasoning Type=NL-Only2026.05 | 54.1 | |
| ASTER-4BReasoning Type=Tool-Integrated2026.05 | 54 | |
| ASTER-4BModel Category=Agentic Reasoning Models2026.02 | 53.9 | |
| Qwen3-4B-Thinking-2507*Reasoning Type=Tool-Integrated, Python Interpreter=prompted2026.05 | 47.8 | |
| gpt-oss-20B (medium)Reasoning Type=NL-Only2026.05 | 46.2 | |
| Qwen3-4B-Thinking-2507Reasoning Type=NL-Only2026.05 | 45.8 | |
| Qwen3.5-27B*Reasoning Type=THINC Teacher, Python Interpreter=prompted2026.05 | 45.7 | |
| Qwen3-4B-Thinking-2507Model Category=Text-Only Reasoning Models2026.02 | 43.6 | |
| OpenReasoning-Nemotron-7BReasoning Type=NL-Only2026.05 | 38.6 | |
| rStar2-Agent-14BReasoning Type=Tool-Integrated2026.05 | 37.4 | |
| DemyAgent-4BReasoning Type=Tool-Integrated2026.05 | 37.1 | |
| DemyAgent-4BModel Category=Agentic Reasoning Models, Inference Budget=30K2026.02 | 35.3 | |
| ReTool-32BReasoning Type=Tool-Integrated2026.05 | 31.8 | |
| ASTER-4B-SFTModel Category=Agentic Reasoning Models2026.02 | 27.4 | |
| ASTER-1.7BModel Category=Agentic Reasoning Models2026.02 | 26.3 | |
| THINC-1.7BReasoning Type=THINC Student2026.05 | 22.7 | |
| Qwen3-1.7B-ThinkingModel Category=Text-Only Reasoning Models2026.02 | 20.8 | |
| Qwen3-1.7BReasoning Type=NL-Only2026.05 | 19.8 | |
| Qwen3-1.7B*Reasoning Type=Tool-Integrated, Python Interpreter=prompted2026.05 | 18.9 | |
| CoRT-1.5BReasoning Type=Tool-Integrated2026.05 | 13.8 | |
| ASTER-1.7B-SFTModel Category=Agentic Reasoning Models2026.02 | 6.4 |