Task progression failure detection on Cover Object (Combined)
100TPRGPT-4o Image QA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4o Image QAmodality=Image QA2026.03 | 100 | 7 | 47 | |
| GPT-4o Video QAmodality=Video QA2026.03 | 100 | 5 | 46 | |
| Gemini 1.5 Pro Video QAmodality=Video QA2026.03 | 100 | 0 | 44 | |
| Claude 3.5 Sonnet Video QA + Success Videomodality=Video QA, context=Success Video2026.03 | 94 | 77 | 85 | |
| Gemini 1.5 Pro Image QAmodality=Image QA2026.03 | 91 | 5 | 42 | |
| Sentinel (STAC MMD* + Claude 3.5 Sonnet Prompt Ensemble*)components=STAC MMD* + Claude 3.5 Sonnet Prompt Ensemble*2026.03 | 88 | 89 | 88 | |
| Claude 3.5 Sonnet Prompt Ensemble*strategy=Prompt Ensemble2026.03 | 85 | 93 | 90 | |
| Sentinel (STAC MMD* + Claude 3.5 Sonnet Video QA)components=STAC MMD* + Claude 3.5 Sonnet Video QA2026.03 | 82 | 80 | 81 | |
| Claude 3.5 Sonnet Video QAmodality=Video QA2026.03 | 79 | 84 | 82 | |
| Claude 3.5 Sonnet Video QA + Goal Imagesmodality=Video QA, context=Goal Images2026.03 | 76 | 93 | 86 | |
| Claude 3.5 Sonnet Image QAmodality=Image QA2026.03 | 71 | 82 | 77 | |
| STAC MMD*variant=MMD2026.03 | 12 | 93 | 58 | |
| Temporal Non-Distr. Min.2026.03 | 9 | 93 | 56 | |
| STAC For. KLvariant=Forward KL2026.03 | 6 | 95 | 56 | |
| STAC Rev. KLvariant=Reverse KL2026.03 | 6 | 93 | 55 | |
| Diffusion Output Variance2026.03 | 0 | 77 | 44 |