Mathematical Reasoning on Beyond-AIME (Avg@5)
77.6Avg@5 ScoreGPT-5-high
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GPT-5-highEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 77.6 | — | — | — | — | — | |
| GPT-5.1-highEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 77.3 | — | — | — | — | — | |
| Gemini-3-Pro-PreviewEvaluation Variant=seeds, Sample Count=1002026.01 | 76.6 | — | — | — | — | — | |
| GPT-5.1-highEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 75.2 | — | — | — | — | — | |
| Gemini-3-Pro-PreviewEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 72.2 | — | — | — | — | — | |
| DeepSeek-V3.1-thinkingEvaluation Variant=seeds, Sample Count=1002026.01 | 71.8 | — | — | — | — | — | |
| GPT-5.1-highEvaluation Variant=seeds, Sample Count=1002026.01 | 71.6 | — | — | — | — | — | |
| GPT-5-highEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 70.6 | — | — | — | — | — | |
| DeepSeek-V3.2-thinkingEvaluation Variant=seeds, Sample Count=1002026.01 | 69.4 | — | — | — | — | — | |
| DeepSeek-V3.2-thinkingEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 68.6 | — | — | — | — | — | |
| DeepSeek-V3.1-thinkingEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 68.6 | — | — | — | — | — | |
| GLM-4.6Evaluation Variant=seeds, Sample Count=1002026.01 | 68.2 | — | — | — | — | — | |
| GPT-5-highEvaluation Variant=seeds, Sample Count=1002026.01 | 68 | — | — | — | — | — | |
| GLM-4.6Evaluation Variant=VeRA-H, Sample Count=5002026.01 | 67.1 | — | — | — | — | — | |
| Gemini-3-Pro-PreviewEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 65.4 | — | — | — | — | — | |
| DeepSeek-V3.2-thinkingEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 64.2 | — | — | — | — | — | |
| GLM-4.6Evaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 63.6 | — | — | — | — | — | |
| DeepSeek-V3.1-thinkingEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 62.2 | — | — | — | — | — | |
| Seed-1.6-1015-highEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 61.8 | — | — | — | — | — | |
| qwen3-max-0923Evaluation Variant=VeRA-H, Sample Count=5002026.01 | 60.1 | — | — | — | — | — | |
| Seed-1.6-1015-highEvaluation Variant=seeds, Sample Count=1002026.01 | 58.8 | — | — | — | — | — | |
| Seed-1.6-Thinking-0715Evaluation Variant=VeRA-H, Sample Count=5002026.01 | 57.9 | — | — | — | — | — | |
| Gemini-2.5-ProEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 57.7 | — | — | — | — | — | |
| Gemini-2.5-ProEvaluation Variant=seeds, Sample Count=1002026.01 | 57.2 | — | — | — | — | — | |
| Minimax-M2Evaluation Variant=seeds, Sample Count=1002026.01 | 56.8 | — | — | — | — | — | |
| Claude-Sonnet-4.5-thinkingEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 56.3 | — | — | — | — | — | |
| Seed-1.6-Lite-1015-highEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 55.6 | — | — | — | — | — | |
| Seed-1.6-1015-highEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 55 | — | — | — | — | — | |
| Kimi-K2-thinkingEvaluation Variant=seeds, Sample Count=1002026.01 | 54.8 | — | — | — | — | — | |
| Seed-1.6-Lite-1015-highEvaluation Variant=seeds, Sample Count=1002026.01 | 54.8 | — | — | — | — | — | |
| Seed-1.6-Thinking-0715Evaluation Variant=seeds, Sample Count=1002026.01 | 54.4 | — | — | — | — | — | |
| qwen3-max-0923Evaluation Variant=seeds, Sample Count=1002026.01 | 53.6 | — | — | — | — | — | |
| Minimax-M2Evaluation Variant=VeRA-H, Sample Count=5002026.01 | 52.8 | — | — | — | — | — | |
| Gemini-2.5-ProEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 52.2 | — | — | — | — | — | |
| qwen3-max-0923Evaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 52.2 | — | — | — | — | — | |
| Claude-Sonnet-4.5-thinkingEvaluation Variant=seeds, Sample Count=1002026.01 | 51.6 | — | — | — | — | — | |
| Seed-1.6-Thinking-0715Evaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 51.6 | — | — | — | — | — | |
| Claude-Sonnet-4.5-thinkingEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 50.2 | — | — | — | — | — | |
| Seed-1.6-Lite-1015-highEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 48.6 | — | — | — | — | — | |
| Minimax-M2Evaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 47.6 | — | — | — | — | — | |
| Kimi-K2-thinkingEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 46.6 | — | — | — | — | — | |
| Kimi-K2-thinkingEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 43.8 | — | — | — | — | — | |
| Kimi-K2-0905Evaluation Variant=seeds, Sample Count=1002026.01 | 37 | — | — | — | — | — | |
| GPT-5.1-chat-latestEvaluation Variant=VeRA-H, Sample Count=5002026.01 | 33 | — | — | — | — | — | |
| GPT-5.1-chat-latestEvaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 32.6 | — | — | — | — | — | |
| Kimi-K2-0905Evaluation Variant=VeRA-H, Sample Count=5002026.01 | 30.4 | — | — | — | — | — | |
| GPT-5.1-chat-latestEvaluation Variant=seeds, Sample Count=1002026.01 | 28.8 | — | — | — | — | — | |
| Kimi-K2-0905Evaluation Variant=VeRA-H Pro, Sample Count=1002026.01 | 25.8 | — | — | — | — | — | |
| Claude-Sonnet-4.5-thinking2026.01 | — | 51.6 | 56.3 | 4.7 | 50.2 | -1.4 | |
| DeepSeek-V3.1-thinking2026.01 | — | 71.8 | 68.6 | -3.2 | 62.2 | -9.6 | |
| DeepSeek-V3.2-thinking2026.01 | — | 69.4 | 68.6 | -0.8 | 64.2 | -5.2 | |
| Gemini-2.5-Pro2026.01 | — | 57.2 | 57.7 | 0.5 | 52.2 | -5 | |
| Gemini-3-Pro-Preview2026.01 | — | 76.6 | 72.2 | -4.4 | 65.4 | -11.2 | |
| GLM-4.62026.01 | — | 68.2 | 67.1 | -1.1 | 63.6 | -4.6 | |
| GPT-5-high2026.01 | — | 68 | 77.6 | 9.6 | 70.6 | 2.6 | |
| GPT-5.1-chat-latest2026.01 | — | 28.8 | 33 | 4.2 | 32.6 | 3.8 | |
| GPT-5.1-high2026.01 | — | 71.6 | 77.3 | 5.7 | 75.2 | 3.6 | |
| Kimi-K2-09052026.01 | — | 37 | 30.4 | -6.6 | 25.8 | -11.2 | |
| Kimi-K2-thinking2026.01 | — | 54.8 | 43.8 | -11 | 46.6 | -8.2 | |
| Minimax-M22026.01 | — | 56.8 | 52.8 | -4 | 47.6 | -9.2 | |
| qwen3-max-09232026.01 | — | 53.6 | 60.1 | 6.5 | 52.2 | -1.4 | |
| Seed-1.6-1015-high2026.01 | — | 58.8 | 61.8 | 3 | 55 | -3.8 | |
| Seed-1.6-Lite-1015-high2026.01 | — | 54.8 | 55.6 | 0.8 | 48.6 | -6.2 | |
| Seed-1.6-Thinking-07152026.01 | — | 54.4 | 57.9 | 3.5 | 51.6 | -2.8 |