Error Localization on WTQ
76.3Exact Match (EM)REFLECT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| REFLECTAuditor model=gpt-5.2, Verification source=Oracle2026.06 | 76.3 | 82.2 | |
| AAO (Opus 4.6)Auditor model=Claude Opus 4.62026.06 | 70.8 | 76.6 | |
| REFLECT (proxy)Auditor model=gpt-5.2, Verification source=Proxy2026.06 | 62.2 | 75.6 | |
| AAOAuditor model=gpt-5.22026.06 | 55.5 | 60.5 | |
| BSAuditor model=gpt-5.22026.06 | 53.8 | 60.5 | |
| Reflexion–noGTAuditor model=gpt-5.2, Ground Truth availability=No2026.06 | 53.3 | 62.8 | |
| Reflexion+GTAuditor model=gpt-5.2, Ground Truth availability=Yes2026.06 | 52.6 | 67.9 | |
| AgentRxAuditor model=gpt-5.22026.06 | 51.1 | 68.6 | |
| SBSAuditor model=gpt-5.22026.06 | 50.4 | 58 | |
| ICSAuditor model=gpt-5.22026.06 | 48.7 | 54.6 | |
| DoVer+GTAuditor model=gpt-5.2, Ground Truth availability=Yes2026.06 | 35 | 52.6 | |
| ThinkPRMAuditor model=gpt-5.22026.06 | 27.7 | 59.9 |