Question Answering on GPQA Diamond (SC K=4 & Our AUC)
77.8SC K=4 AccuracyGemini 3.1 Pro
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Gemini 3.1 ProCond.=—2026.05 | 77.8 | 69 | 70.1 | |
| Claude Sonnet 4.6Cond.=—2026.05 | 69.9 | 74.7 | 72.7 |
Loading the SOTA2 catalog…
| Method | Links | |||
|---|---|---|---|---|
| Gemini 3.1 ProCond.=—2026.05 | 77.8 | 69 | 70.1 | |
| Claude Sonnet 4.6Cond.=—2026.05 | 69.9 | 74.7 | 72.7 |