Factual Question Answering on SimpleQA (test)
79.07AccuracyHEART
Evaluation results
| Method | Links | |
|---|---|---|
| HEARTModel=Gemini 3 Pro, Prompt Strategy=HEART, Setting=Human-in-the-Loop Proxy2025.09 | 79.07 | |
| WaitModel=Gemini 3 Pro, Prompt Strategy=Wait, Setting=Human-in-the-Loop Proxy2025.09 | 73.61 | |
| Self ReflectionModel=Gemini 3 Pro, Prompt Strategy=Self Reflection, Setting=Human-in-the-Loop Proxy2025.09 | 72.91 | |
| CoTModel=Gemini 3 Pro, Prompt Strategy=CoT, Setting=Human-in-the-Loop Proxy2025.09 | 72.73 | |
| VanillaModel=Gemini 3 Pro, Prompt Strategy=Vanilla, Setting=Human-in-the-Loop Proxy2025.09 | 70.7 | |
| HEARTModel=Gemini 3 Flash, Prompt Strategy=HEART, Setting=Human-in-the-Loop Proxy2025.09 | 59.85 | |
| CoTModel=Gemini 3 Flash, Prompt Strategy=CoT, Setting=Human-in-the-Loop Proxy2025.09 | 58.38 | |
| WaitModel=Gemini 3 Flash, Prompt Strategy=Wait, Setting=Human-in-the-Loop Proxy2025.09 | 55.1 | |
| Self ReflectionModel=Gemini 3 Flash, Prompt Strategy=Self Reflection, Setting=Human-in-the-Loop Proxy2025.09 | 53.1 | |
| VanillaModel=Gemini 3 Flash, Prompt Strategy=Vanilla, Setting=Human-in-the-Loop Proxy2025.09 | 34.19 |