Failure Detection on LIBERO seen
0.061Brier ScoreSAFE-RNN-TDQC (Ours)
Evaluation Results
| Method | Links | |
|---|---|---|
| SAFE-RNN-TDQC (Ours)VLA Model=π02026.04 | 0.061 | |
| SAFE-RNN-TDQC (Ours)VLA Model=UniVLA2026.04 | 0.064 | |
| SAFE-MLP-TDQC (Ours)VLA Model=UniVLA2026.04 | 0.066 | |
| SAFE-MLP-TDQC (Ours)VLA Model=π02026.04 | 0.068 | |
| SAFE-MLP BCEVLA Model=π02026.04 | 0.075 | |
| SAFE-MLP BCEVLA Model=UniVLA2026.04 | 0.091 | |
| RNN-TDQC (Ours)VLA Model=UniVLA2026.04 | 0.1 | |
| SAFE-RNN-TDQC (Ours)VLA Model=π0-FAST2026.04 | 0.103 | |
| SAFE-MLP BCEVLA Model=π0-FAST2026.04 | 0.103 | |
| RNN-TDQC (Ours)VLA Model=π0-FAST2026.04 | 0.105 | |
| SAFE-RNNVLA Model=π0-FAST2026.04 | 0.106 | |
| SAFE-MLP-TDQC (Ours)VLA Model=π0-FAST2026.04 | 0.109 | |
| RNN-BCEVLA Model=π0-FAST2026.04 | 0.122 | |
| SAFE-RNNVLA Model=π02026.04 | 0.123 | |
| SAFE-RNNVLA Model=UniVLA2026.04 | 0.124 | |
| RNN-BCEVLA Model=UniVLA2026.04 | 0.138 | |
| RNN-TDQC (Ours)VLA Model=OpenVLA2026.04 | 0.191 | |
| SAFE-MLP BCEVLA Model=OpenVLA2026.04 | 0.192 | |
| SAFE-MLP-TDQC (Ours)VLA Model=OpenVLA2026.04 | 0.195 | |
| SAFE-RNN-TDQC (Ours)VLA Model=OpenVLA2026.04 | 0.197 | |
| RNN-BCEVLA Model=OpenVLA2026.04 | 0.199 | |
| SAFE-RNNVLA Model=OpenVLA2026.04 | 0.204 | |
| Avg entropyVLA Model=π0-FAST2026.04 | 0.209 | |
| Avg prob.VLA Model=π0-FAST2026.04 | 0.212 | |
| Running Avg prob.VLA Model=π0-FAST2026.04 | 0.244 | |
| Running Avg entropyVLA Model=OpenVLA2026.04 | 0.265 | |
| Running Avg entropyVLA Model=π0-FAST2026.04 | 0.279 | |
| Avg entropyVLA Model=OpenVLA2026.04 | 0.306 | |
| Max prob.VLA Model=π0-FAST2026.04 | 0.32 | |
| Running Avg prob.VLA Model=OpenVLA2026.04 | 0.338 | |
| Running Avg entropyVLA Model=UniVLA2026.04 | 0.343 | |
| Avg prob.VLA Model=OpenVLA2026.04 | 0.348 | |
| Max prob.VLA Model=OpenVLA2026.04 | 0.395 | |
| Avg entropyVLA Model=UniVLA2026.04 | 0.406 | |
| Avg prob.VLA Model=UniVLA2026.04 | 0.529 | |
| Running Avg prob.VLA Model=UniVLA2026.04 | 0.543 | |
| Max prob.VLA Model=UniVLA2026.04 | 0.909 |