List your company

Mathematical Reasoning on AIME24 (EM, #Tool)

36.7EM AccuracyToRL-GRPO
8.93216.14123.3530.559Jun 15, 2026

Evaluation results

MethodLinks
ToRL-GRPOBase Model=Qwen2.5-Math-7B, Tool Use=Yes2026.0636.72.1
OTC-GRPOBase Model=Qwen2.5-Math-7B, Tool Use=Yes2026.0636.70.7
ParetoPOBase Model=Qwen2.5-Math-7B, Tool Use=Yes2026.0636.70.8
ParetoPOBase Model=Qwen2.5-Math-1.5B, Tool Use=Yes2026.06300.8
Qwen2.5-Math-7B-Ins-TIRBase Model=Qwen2.5-Math-7B, Tool Use=Yes2026.0626.71.6
MO-GRPOBase Model=Qwen2.5-Math-7B, Tool Use=Yes2026.0626.71.8
ToRL-GRPOBase Model=Qwen2.5-Math-1.5B, Tool Use=Yes2026.0623.32.2
OTC-GRPOBase Model=Qwen2.5-Math-1.5B, Tool Use=Yes2026.06201.1
MO-GRPOBase Model=Qwen2.5-Math-1.5B, Tool Use=Yes2026.0616.71.8
Qwen2.5-Math-1.5B-Ins-TIRBase Model=Qwen2.5-Math-1.5B, Tool Use=Yes2026.0613.31.1
Qwen2.5-Math-1.5B-InsBase Model=Qwen2.5-Math-1.5B, Tool Use=No2026.0610—
Qwen2.5-Math-7B-InsBase Model=Qwen2.5-Math-7B, Tool Use=No2026.0610—