Early Failure Detection on RoboCasa S (Unseen)
73.8ROC-AUC (q=0.25)ActProbe
Evaluation results
| Method | Links | |
|---|---|---|
| ActProbePolicy=π0.52026.06 | 73.8 | |
| SAFE-LSTMPolicy=π0.52026.06 | 73.1 | |
| SAFE-MLPPolicy=π0.52026.06 | 71 | |
| SAFE-MLP-TDQCPolicy=π0.52026.06 | 70.4 | |
| LogpZOPolicy=π0.52026.06 | 67.2 | |
| STAC-SinglePolicy=π0.52026.06 | 66 | |
| SAFE-LSTM-TDQCPolicy=π0.52026.06 | 62.4 | |
| Cosine k-NNPolicy=π0.52026.06 | 44.4 |