Rollout-level failure detection on BEHAVIOR-1K (test)
76ROC-AUCForesight-Transformer
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Foresight-Transformerarchitecture=Transformer, action-conditioned=true2026.06 | 76 | 78 | |
| Foresight-LSTMarchitecture=LSTM, action-conditioned=true2026.06 | 75 | 75 | |
| Foresight-MLParchitecture=MLP, action-conditioned=true2026.06 | 73 | 56 | |
| SAFE-LSTMarchitecture=LSTM2026.06 | 72 | 64 | |
| RND2026.06 | 65 | 54 | |
| Gauge2026.06 | 61 | 60 | |
| FAIL-Detect2026.06 | 54 | 52 | |
| SAFE-MLParchitecture=MLP2026.06 | 50 | 50 |