Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Rollout-level failure detection research benchmarks · SOTA2 Research

Rollout-level failure detection

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

BEHAVIOR-1K (test)

Foresight-Transformer

76ROC-AUC

8

Jun 23, 2026

ManiSkill-Long (test)

Foresight-Transformer

84ROC-AUC

8

Jun 23, 2026

LIBERO Long (test)

91ROC-AUC

8

Jun 23, 2026

Franka arm GR00T N1.5 policy rollouts

Foresight-Transformer

89ROC-AUC

7

Jun 23, 2026

ReactorX arm SmolVLA policy rollouts

0.82ROC-AUC

7

Jun 23, 2026

ReactorX arm π0.5 policy rollouts

Foresight-Transformer

0.87ROC-AUC

7

Jun 23, 2026

ReactorX arm ACT policy rollouts

Foresight-Transformer

0.93ROC-AUC

7

Jun 23, 2026

Popular datasets

ReactorX arm LIBERO Behavior ManiSkill Franka Arm

Follow for updates

Join SOTA2 Contact