Reasoning on Humanity's Last Exam (HLE) (test)
72.19AccuracyHEART
Evaluation Results
| Method | Links | |
|---|---|---|
| HEARTModel=Gemini 3 Pro, Prompt Strategy=HEART, Setting=Human-in-the-Loop Proxy2025.09 | 72.19 | |
| Self ReflectionModel=Gemini 3 Pro, Prompt Strategy=Self Reflection, Setting=Human-in-the-Loop Proxy2025.09 | 68.58 | |
| CoTModel=Gemini 3 Pro, Prompt Strategy=CoT, Setting=Human-in-the-Loop Proxy2025.09 | 68.14 | |
| WaitModel=Gemini 3 Pro, Prompt Strategy=Wait, Setting=Human-in-the-Loop Proxy2025.09 | 66.3 | |
| HEARTModel=Gemini 3 Flash, Prompt Strategy=HEART, Setting=Human-in-the-Loop Proxy2025.09 | 58.89 | |
| WaitModel=Gemini 3 Flash, Prompt Strategy=Wait, Setting=Human-in-the-Loop Proxy2025.09 | 49.37 | |
| Self ReflectionModel=Gemini 3 Flash, Prompt Strategy=Self Reflection, Setting=Human-in-the-Loop Proxy2025.09 | 48.36 | |
| CoTModel=Gemini 3 Flash, Prompt Strategy=CoT, Setting=Human-in-the-Loop Proxy2025.09 | 46.83 | |
| VanillaModel=Gemini 3 Pro, Prompt Strategy=Vanilla, Setting=Human-in-the-Loop Proxy2025.09 | 40.8 | |
| VanillaModel=Gemini 3 Flash, Prompt Strategy=Vanilla, Setting=Human-in-the-Loop Proxy2025.09 | 12 |