Mathematical Reasoning on Beyond-AIME (Seed, VeRA-E, ∆)
76.6Seed ScoreGemini-3-Pro-Preview
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-3-Pro-PreviewEvaluation Protocol=Avg@5 (%)2026.01 | 76.6 | 74 | -2.6 | |
| DeepSeek-V3.1-thinkingEvaluation Protocol=Avg@5 (%)2026.01 | 71.8 | 66 | -5.8 | |
| GPT-5.1-highEvaluation Protocol=Avg@5 (%)2026.01 | 71.6 | 73 | 1.4 | |
| DeepSeek-V3.2-thinkingEvaluation Protocol=Avg@5 (%)2026.01 | 69.4 | 67.6 | -1.8 | |
| GLM-4.6Evaluation Protocol=Avg@5 (%)2026.01 | 68.2 | 66.4 | -1.8 | |
| GPT-5-highEvaluation Protocol=Avg@5 (%)2026.01 | 68 | 69.8 | 1.8 | |
| Seed-1.6-1015-highEvaluation Protocol=Avg@5 (%)2026.01 | 58.8 | 58.2 | -0.6 | |
| Gemini-2.5-ProEvaluation Protocol=Avg@5 (%)2026.01 | 57.2 | 57 | -0.2 | |
| Minimax-M2Evaluation Protocol=Avg@5 (%)2026.01 | 56.8 | 54.4 | -2.4 | |
| Kimi-K2-thinkingEvaluation Protocol=Avg@5 (%)2026.01 | 54.8 | 44 | -10.8 | |
| Seed-1.6-Lite-1015-highEvaluation Protocol=Avg@5 (%)2026.01 | 54.8 | 53.6 | -1.2 | |
| Seed-1.6-Thinking-0715Evaluation Protocol=Avg@5 (%)2026.01 | 54.4 | 55.8 | 1.4 | |
| qwen3-max-0923Evaluation Protocol=Avg@5 (%)2026.01 | 53.6 | 58.8 | 5.2 | |
| Claude-Sonnet-4.5-thinkingEvaluation Protocol=Avg@5 (%)2026.01 | 51.6 | 53 | 1.4 | |
| Kimi-K2-0905Evaluation Protocol=Avg@5 (%)2026.01 | 37 | 34.6 | -2.4 | |
| GPT-5.1-chat-latestEvaluation Protocol=Avg@5 (%)2026.01 | 28.8 | 30.6 | 1.8 |