Error Localization on GAIA
39EM (Exact Match)REFLECT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| REFLECTAuditor model=gpt-5.2, Verification source=Oracle2026.06 | 39 | 66.3 | |
| REFLECT (proxy)Auditor model=gpt-5.2, Verification source=Proxy2026.06 | 33.3 | 68.2 | |
| Reflexion–noGTAuditor model=gpt-5.2, Ground Truth availability=No2026.06 | 17.9 | 45.3 | |
| Reflexion+GTAuditor model=gpt-5.2, Ground Truth availability=Yes2026.06 | 16.2 | 47.9 | |
| DoVer+GTAuditor model=gpt-5.2, Ground Truth availability=Yes2026.06 | 16.2 | 32.5 | |
| AAOAuditor model=gpt-5.22026.06 | 15.7 | 62.7 | |
| AAO (Opus 4.6)Auditor model=Claude Opus 4.62026.06 | 15.4 | 49.6 | |
| ThinkPRMAuditor model=gpt-5.22026.06 | 14.5 | 35 | |
| BSAuditor model=gpt-5.22026.06 | 13.3 | 48.2 | |
| ICSAuditor model=gpt-5.22026.06 | 10.8 | 43.4 | |
| AgentRxAuditor model=gpt-5.22026.06 | 6.8 | 31.6 | |
| SBSAuditor model=gpt-5.22026.06 | 1.2 | 34.9 |