WOMD
Benchmarks
TaskDatasetSOTA resultTrendResults
WOMD
65.57Attack Success Rate
17
WOMD (val)
0.523minADE
11
WOMD 1.0 (test)
44.92mAP
9
WOMD WOSAC 1.2 (test)
76.63Realism Score
8
WOMD
0.915mADE
8
WOMD (val)
2.83NLL (bits)
8
WOMD
1.98Collision Rate
8
WOMD Sim Agents 2024
75.11Realism Score
7
WOMD Normal scenarios
11.8Crash Rate
6
WOMD Adversarial scenarios (test)
31.37Crash Rate
6
WOMD closed-loop (test)
0.72Acceleration Error (m/s^2)
6
WOMD Scenario
0.47Acceleration (m/s^2)
6
WOMD interactive (val)
0.68minADE (m)
6
WOMD
0.915CR
5
WOMD (2% val)
2.7Collision Rate
5
WOMD
287.17Coverage
4
WOMD adversarial environments, w_adv=1.0 (test)
45.14Reward
4
WOMD Top-10% Safety-Critical
17.12Collision Rate
4
WOMD Overall-3000
0.023Collision Rate
4
WOMD 100 scenarios (val)
24.52TTC (s)
3
WOMD (val)
0.766AUC-ROC
3
WOMD Long-Horizon 60s
0.35Collision Rate
3
WOMD 1.0 (val)
0.415mAP
2