Failure Detection on VLABench (Unseen Tasks)
71.3bACCHide-and-Seek
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Hide-and-SeekPolicy=π0.52026.05 | 71.3 | 70.9 | 60.8 | |
| Cosine k-NNPolicy=π0.52026.05 | 70.4 | 67.6 | 58.4 | |
| LogpZOPolicy=π0.52026.05 | 67.4 | 62.8 | 58.1 | |
| SAFE-MLPPolicy=π0.52026.05 | 64.1 | 63.4 | 50 | |
| PCA KMeansPolicy=π0.52026.05 | 61.6 | 61.8 | 52 | |
| MahalanobisPolicy=π0.52026.05 | 61.1 | 54.8 | 54.5 | |
| STACPolicy=π0.52026.05 | 59.1 | 59.8 | 57.6 | |
| ACEPolicy=π0.52026.05 | 59.1 | 59.5 | 55.2 | |
| EigenScorePolicy=π0.52026.05 | 56.6 | 53.8 | 55.4 | |
| RNDPolicy=π0.52026.05 | 55.1 | 53.7 | 50.7 | |
| Cluster EntropyPolicy=π0.52026.05 | 52.6 | 50.6 | 49 | |
| SAFE-LSTMPolicy=π0.52026.05 | 48.4 | 53.3 | 48.2 |