Rollout-level failure detection on ManiSkill-Long (test)
84ROC-AUCForesight-Transformer
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Foresight-Transformerarchitecture=Transformer, action-conditioned=true2026.06 | 84 | 80 | |
| RND2026.06 | 83 | 68 | |
| SAFE-LSTMarchitecture=LSTM2026.06 | 82 | 74 | |
| Gauge2026.06 | 80 | 77 | |
| Foresight-LSTMarchitecture=LSTM, action-conditioned=true2026.06 | 76 | 79 | |
| FAIL-Detect2026.06 | 71 | 50 | |
| Foresight-MLParchitecture=MLP, action-conditioned=true2026.06 | 70 | 71 | |
| SAFE-MLParchitecture=MLP2026.06 | 61 | 53 |