Mathematical Reasoning on AIME 2026 (Accuracy, Average tokens generated)
86.67AccuracyGemma-4 31B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemma-4 31BEvaluation Mode=Reasoning+Rotate2Think2026.06 | 86.67 | 3,098 | |
| Gemma-4 31BEvaluation Mode=Base+Rotate2Think2026.06 | 83.33 | 2,036 | |
| Gemma-4 31BEvaluation Mode=Reasoning2026.06 | 83.33 | 7,894 | |
| Phi-4 14BEvaluation Mode=Reasoning+Rotate2Think2026.06 | 80 | 17,540 | |
| Gemma-4 31BEvaluation Mode=Base2026.06 | 80 | 2,119 | |
| Phi-4 14BEvaluation Mode=Reasoning2026.06 | 76.67 | 17,077 | |
| Qwen3 4BEvaluation Mode=Reasoning+Rotate2Think2026.06 | 73.33 | 21,076 | |
| Qwen3 4BEvaluation Mode=Reasoning2026.06 | 70 | 20,609 | |
| Qwen3 4BEvaluation Mode=Base+Rotate2Think2026.06 | 53.33 | 8,855 | |
| Gemma-4 E4BEvaluation Mode=Reasoning+Rotate2Think2026.06 | 53.33 | 5,586 | |
| Gemma-4 E4BEvaluation Mode=Base+Rotate2Think2026.06 | 46.67 | 5,422 | |
| Gemma-4 E4BEvaluation Mode=Reasoning2026.06 | 43.33 | 6,829 | |
| Qwen3 4BEvaluation Mode=Base2026.06 | 40 | 9,359 | |
| Gemma-4 E4BEvaluation Mode=Base2026.06 | 33.33 | 3,691 | |
| Phi-4 14BEvaluation Mode=Base+Rotate2Think2026.06 | 16.67 | 1,515 | |
| Phi-4 14BEvaluation Mode=Base2026.06 | 10 | 1,380 |