Simulation
Benchmarks
TaskDatasetSOTA resultTrendResults
Simulation CityU-01-F06
0.052ATE Translation (m)
6
Simulation CaseStudy-06
0.043ATE Translation (m)
6
Simulation CaseStudy-05
0.008ATE Translation (m)
6
Simulation CaseStudy-04
0.007ATE Translation [m]
6
Simulation CaseStudy-03
0.009ATE Translation [m]
6
Simulation CaseStudy-02-2
0.034ATE Translation (m)
6
Simulation CaseStudy-02-1
0.029ATE Translation [m]
6
Simulation CaseStudy-01
0.011ATE Translation (m)
6
10-simulation (test)
1.24MAE (vehicles)
6
Simulation single lag (tau = 1)
99.67Accuracy
6
Simulation Poisson (test)
0.418AMSE
6
Simulation Bernoulli (test)
0.111AMSE
6
Simulation Damped Pull Door
100Success Rate
6
Simulation (test)
96.4Stack Success Rate
6
Simulation (test)
91.8Lift
6
Simulation (test)
89.5Grasp Success Rate
6
Simulation (test)
99.5Touch Rate
6
Simulation 3.5
324.4Run Time (s)
6
Simulation 3.4
108.8Run time (seconds)
6
Supplementary stress-test simulation (test)
0.382MSE (Overall)
5
Simulation
70Success Rate
5
Simulation
81.2Success Rate
5
Simulation Case 2
0.42RISE Score
5
Simulation Case 1
49RISE Score
5
Simulation
1.72Position Error (Delta X) (cm)
5