Scientific Problem Solving on SciBench (Accuracy, Δ)
72.1Accuracyo3
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| o3Reasoning Effort=High2025.08 | 72.1 | 2.4 | |
| GPT-5Reasoning Effort=High2025.08 | 72 | 1.6 | |
| Gemini-2.5-ProReasoning Effort=Low2025.08 | 71 | — | |
| GPT-5Reasoning Effort=Low2025.08 | 70.4 | — | |
| Gemini-2.5-ProReasoning Effort=High2025.08 | 70.2 | -0.8 | |
| o3Reasoning Effort=Low2025.08 | 69.7 | — | |
| o4-miniReasoning Effort=High2025.08 | 69.7 | 4.2 | |
| Claude-Sonnet-4Reasoning Effort=High2025.08 | 67.1 | 1.6 | |
| o3-miniReasoning Effort=High2025.08 | 66.3 | 20.3 | |
| o4-miniReasoning Effort=Low2025.08 | 65.5 | — | |
| Claude-Sonnet-4Reasoning Effort=Low2025.08 | 65.5 | — | |
| o3-miniReasoning Effort=Low2025.08 | 46 | — |