Scientific and Mathematical Reasoning on OlympiadBench (test)
99.63Math AccuracyHEART
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HEARTModel=Gemini 3 Pro, Prompt Strategy=HEART, Setting=Human-in-the-Loop Proxy2025.09 | 99.63 | 92.88 | |
| Self ReflectionModel=Gemini 3 Pro, Prompt Strategy=Self Reflection, Setting=Human-in-the-Loop Proxy2025.09 | 99.44 | 84.1 | |
| WaitModel=Gemini 3 Pro, Prompt Strategy=Wait, Setting=Human-in-the-Loop Proxy2025.09 | 99.44 | 88.28 | |
| CoTModel=Gemini 3 Pro, Prompt Strategy=CoT, Setting=Human-in-the-Loop Proxy2025.09 | 99.26 | 87.38 | |
| VanillaModel=Gemini 3 Pro, Prompt Strategy=Vanilla, Setting=Human-in-the-Loop Proxy2025.09 | 94.33 | 79.79 | |
| HEARTModel=Gemini 3 Flash, Prompt Strategy=HEART, Setting=Human-in-the-Loop Proxy2025.09 | 92.41 | 82.94 | |
| WaitModel=Gemini 3 Flash, Prompt Strategy=Wait, Setting=Human-in-the-Loop Proxy2025.09 | 89.07 | 75.13 | |
| Self ReflectionModel=Gemini 3 Flash, Prompt Strategy=Self Reflection, Setting=Human-in-the-Loop Proxy2025.09 | 88.52 | 71.96 | |
| CoTModel=Gemini 3 Flash, Prompt Strategy=CoT, Setting=Human-in-the-Loop Proxy2025.09 | 87.41 | 72.94 | |
| VanillaModel=Gemini 3 Flash, Prompt Strategy=Vanilla, Setting=Human-in-the-Loop Proxy2025.09 | 78.44 | 65.08 |