Franka
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Franka unseen
0.215Brier Score
11
Franka seen
0.15Brier Score
11
Franka Real-world
80Success Rate
8
Franka Real-world Dataset
55Success Rate
8
Franka Real-world
95Success Rate
8
Franka
67Task Success Rate (SRtask)
5
Franka
99.5Task Success Rate
5
Franka Free-space setting
0L1 Error (Nm)
5
Franka (test)
421.9FVD
4
Franka Deployment Real-world Low-light
70Success Rate
4
Franka Normal lighting (real-world deployment)
75Success Rate
4
Franka Real-World Robot Evaluation
8Success Rate
4
Franka Contact setting
0L1 Error (Nm)
4
Real-world Franka
14Success Rate
4
Franka Avg. 1.0 (test)
75.2Success Rate (SR)
4
Franka 2.5 rad bin 1.0 (test)
44.7Success Rate
4
Franka 2.0 rad bin 1.0 (test)
67.7Success Rate (SR)
4
Franka 1.5 rad bin 1.0 (test)
81.7Success Rate
4
Franka rad bin 1.0 (test)
89Success Rate
4
Franka 0.5 rad bin 1.0 (test)
93Success Rate (SR)
4
Franka Real-world Environment
55Success Rate
4
Franka Real-world Environment
90Success Rate
4
Franka
7.737MAE
4
Real-world Franka
25PlaceToy Success Rate
4
Franka Real-world Individual Tasks (real-robot)
80Pick Bread Success Rate
4