Mathematical Reasoning on Beyond AIME (avg@16 accuracy, pass@8)
29.3Avg@16 AccuracyTEMPO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TEMPOBackbone=Qwen3-14B-Base2026.04 | 29.3 | 46.3 | |
| EMPOBackbone=Qwen3-14B-Base2026.04 | 27.6 | 31.4 | |
| TTRLBackbone=Qwen3-14B-Base2026.04 | 25.5 | 29.4 | |
| Zero-RL (PPO)Backbone=Qwen3-14B-Base2026.04 | 24.9 | 50 | |
| TEMPOBackbone=OLMO3-7B-Base2026.04 | 24.5 | 44 | |
| TTRLBackbone=OLMO3-7B-Base2026.04 | 21.8 | 22.3 | |
| EMPOBackbone=OLMO3-7B-Base2026.04 | 21.3 | 28.4 | |
| TEMPOBackbone=Qwen3-8B-Base2026.04 | 20 | 36.7 | |
| TTRLBackbone=Qwen3-8B-Base2026.04 | 18.7 | 20 | |
| Zero-RL (PPO)Backbone=OLMO3-7B-Base2026.04 | 17.6 | 38.8 | |
| EMPOBackbone=Qwen3-8B-Base2026.04 | 16.7 | 23.3 | |
| Zero-RL (PPO)Backbone=Qwen3-8B-Base2026.04 | 15.6 | 33.6 | |
| MiMo-Zero-RL-7BBackbone=MiMo-Zero-RL-7B2026.04 | 14.6 | 33.1 | |
| OLMO3.1-Zero-RL-7BBackbone=OLMO3.1-Zero-RL-7B2026.04 | 13.8 | 32.1 | |
| Oat-Zero-7BBackbone=Oat-Zero-7B2026.04 | 9.4 | 19.4 |