Task Progression Failure Detection on Close Box Out-of-Distribution
100TPRGPT-4o Image QA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4o Image QAFailure Detector Category=VLM2026.03 | 100 | — | 22.68 | |
| Gemini 1.5 Pro Video QAFailure Detector Category=VLM2026.03 | 98 | — | 15.47 | |
| Gemini 1.5 Pro Image QAFailure Detector Category=VLM2026.03 | 96 | — | 23.2 | |
| SentinelComponents=STAC MMD* + GPT-4o Video QA*2026.03 | 96 | — | 12.2 | |
| GPT-4o Video QA*Failure Detector Category=VLM2026.03 | 87 | — | 22 | |
| Claude 3.5 Sonnet Video QAFailure Detector Category=VLM2026.03 | 80 | — | 23.2 | |
| Claude 3.5 Sonnet Image QAFailure Detector Category=VLM2026.03 | 78 | — | 23.2 | |
| Temporal Non-Distr. Min.Failure Detector Category=Diff.2026.03 | 67 | — | 7.46 | |
| STAC For. KLFailure Detector Category=STAC2026.03 | 61 | — | 8.14 | |
| STAC Rev. KLFailure Detector Category=STAC2026.03 | 61 | — | 10.11 | |
| STAC MMD*Failure Detector Category=STAC2026.03 | 61 | — | 9.06 | |
| Diffusion Output VarianceFailure Detector Category=Diff.2026.03 | 28 | — | 11.57 |