Question Answering on GPQA Diamond (Seed, VeRA-E, ∆)
86.7Seed ScoreGemini-3-Pro-Preview
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-3-Pro-PreviewEvaluation Protocol=Avg@5 (%)2026.01 | 86.7 | 85.7 | -1 | |
| GPT-5.1-highEvaluation Protocol=Avg@5 (%)2026.01 | 86.4 | 84.5 | -1.8 | |
| Gemini-2.5-ProEvaluation Protocol=Avg@5 (%)2026.01 | 82.1 | 81.4 | -0.8 | |
| DeepSeek-V3.2-thinkingEvaluation Protocol=Avg@5 (%)2026.01 | 82.1 | 83.3 | 1.2 | |
| GPT-5-highEvaluation Protocol=Avg@5 (%)2026.01 | 81.9 | 82.1 | 0.1 | |
| Claude-Sonnet-4.5-thinkingEvaluation Protocol=Avg@5 (%)2026.01 | 81 | 80.1 | -0.9 | |
| DeepSeek-V3.1-thinkingEvaluation Protocol=Avg@5 (%)2026.01 | 80 | 81.3 | 1.3 | |
| Kimi-K2-thinkingEvaluation Protocol=Avg@5 (%)2026.01 | 79.9 | 83.4 | 3.5 | |
| GLM-4.6Evaluation Protocol=Avg@5 (%)2026.01 | 78.8 | 80.2 | 1.4 | |
| Seed-1.6-Thinking-0715Evaluation Protocol=Avg@5 (%)2026.01 | 78.4 | 78.5 | 0.1 | |
| Seed-1.6-Lite-1015-highEvaluation Protocol=Avg@5 (%)2026.01 | 77.6 | 76.9 | -0.7 | |
| Seed-1.6-1015-highEvaluation Protocol=Avg@5 (%)2026.01 | 77.4 | 78.9 | 1.5 | |
| Minimax-M2Evaluation Protocol=Avg@5 (%)2026.01 | 76.7 | 74.4 | -2.3 | |
| qwen3-max-0923Evaluation Protocol=Avg@5 (%)2026.01 | 76.1 | 76.7 | 0.7 | |
| Kimi-K2-0905Evaluation Protocol=Avg@5 (%)2026.01 | 73.5 | 74.2 | 0.7 | |
| GPT-5.1-chat-latestEvaluation Protocol=Avg@5 (%)2026.01 | 69.9 | 69.1 | -0.8 |