Scenario
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Scenario 2 (Plate, Bowl) - Transfer
94.4Success Rate
3
Scenario Plate, Bowl, Seen 2
97.2Success Rate
3
Scenario 1 (Back, Rotate) - Transfer
91.7Success Rate
3
Scenario 1 Back, Rotate Seen
97.2Success Rate
3
Scenario IV
0.25Safety Index
3
Scenario III
0.38Safety Index
3
Scenario II
0.4Safety Index
3
Scenario I
0.5Safety Index
3
Scenario 1
10.36Traveled Distance (m)
3
Scenario S1
40.118Path Length (m)
3
Scenario 2
0.211MAE (τ=0.05)
3
Scenario 5 Road intersection
0.947Safety Metric
3
Scenario 3 Narrow Passage
78.7Safety Metric
3
Scenario Roundabout 2
65.2Safety Score
3
Scenario Warehouse (4 agents) 1-1
93.2Safety Score
3
Scenario-3
2.44Median RMSE
3
Scenario 3
3.03Median RMSE
3
Scenario-2
2.78Median RMSE [Q1, Q3]
3
Scenario 1
3.31Median RMSE
3
Scenario 3
0Median RMSE
3
Scenario 2
0Median RMSE
3
Scenario 1
0Median RMSE (IQR)
3
Scenario-2 Synthetic (test)
5.93RMSE
3
Scenario-1 Synthetic (test)
8.45RMSE
3
Scenario S4
6.78Mean Violation
3