Computational Reasoning on AIME24, AIME25, AMC23, GSM8K, MATH
20.1AIME24 ScoreTool-Star
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Tool-StarBackbone=Qwen2.5-3B, Agent Category=Multi-Tool Integrated Agent2026.04 | 20.1 | 12.9 | 52 | 69.8 | 85 | |
| E3-TIRBackbone=Qwen2.5-3B, Agent Category=Multi-Tool Integrated Agent2026.04 | 19 | 20.8 | 56 | 72.3 | 85.2 | |
| SimpleTIRBackbone=Qwen2.5-3B, Agent Category=LLM-based Math Agent2026.04 | 17.5 | 19.1 | 54.3 | 69.4 | 83.9 | |
| ARPOBackbone=Qwen2.5-3B, Agent Category=Multi-Tool Integrated Agent2026.04 | 16.2 | 20.6 | 52 | 70.2 | 85.7 | |
| ToRLBackbone=Qwen2.5-3B, Agent Category=LLM-based Math Agent2026.04 | 10 | 20 | 53 | 72 | 84.4 | |
| Tree-GRPOBackbone=Qwen2.5-3B, Agent Category=LLM-based Search Agent2026.04 | 9.2 | 16.6 | 32.5 | 52.3 | 56.5 | |
| Search-o1Backbone=Qwen2.5-3B, Agent Category=LLM-based Search Agent2026.04 | 8.6 | 10.3 | 36.5 | 58.6 | 74.2 | |
| ReCallBackbone=Qwen2.5-3B, Agent Category=Multi-Tool Integrated Agent2026.04 | 7.6 | 12.4 | 48.2 | 68.6 | 84.1 | |
| Qwen2.5-3B-InstructBackbone=Qwen2.5-3B2026.04 | 4.5 | 8.6 | 38.3 | 65.3 | 81 | |
| Search-R1Backbone=Qwen2.5-3B, Agent Category=LLM-based Search Agent2026.04 | 3.3 | 10 | 31.2 | 58 | 60.5 |