Mathematical Problem Solving on AIME VeRA-H 2024-II
0.909Avg@5 (%)GPT-5.1-high
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-5.1-high2026.01 | 0.909 | -3.4 | |
| DeepSeek-V3.2-thinking2026.01 | 0.84 | -7.4 | |
| GPT-5-high2026.01 | 0.823 | -6.3 | |
| Gemini-2.5-Pro2026.01 | 0.82 | -10.9 | |
| GLM-4.62026.01 | 0.811 | -13.1 | |
| DeepSeek-V3.1-thinking2026.01 | 0.811 | -8.9 | |
| Seed-1.6-Thinking-07152026.01 | 0.766 | -10.6 | |
| Seed-1.6-1015-high2026.01 | 0.766 | -16.3 | |
| Gemini-3-Pro-Preview2026.01 | 0.746 | -1.1 | |
| Claude-Sonnet-4.5-thinking2026.01 | 0.72 | -18 | |
| Seed-1.6-Lite-1015-high2026.01 | 0.703 | -18.3 | |
| Minimax-M22026.01 | 0.643 | -18.6 | |
| Qwen3-max-09232026.01 | 0.591 | -20.9 | |
| Kimi-K2-09052026.01 | 0.406 | -30.9 | |
| GPT-5.1-chat-latest2026.01 | 0.343 | -18.6 | |
| Kimi-K2-thinking2026.01 | 0.151 | -70.6 |