CARLA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CARLA Town02
78.34Average Time (AT)
4
CARLA 4 random obstacles (100 trials)
1.994Average Acceleration
4
CARLA racing
74Finish Rate
4
CARLA simulator
2.48Mean PET (s)
4
CARLA Synthetic Motion Blur x 4
0.303mAP
4
CARLA Synthetic Motion Blur x 2
0.3mAP
4
CARLA Synthetic Noise x 20
28.9mAP
4
CARLA Synthetic Noise x 10
29.6mAP
4
CARLA Synthetic Calibrated
32.5mAP
4
CARLA (test)
12.4CD1
4
CARLA LAV towns (val)
94Driving Score
4
CARLA (test)
5.97FID
4
CARLA Town05 Long 0.9.10.1
41.45DS
4
CARLA Town05 Short 0.9.10.1
55.14DS Score
4
CARLA 150 expert demonstrations daytime (test)
30Success Rate
4
CARLA 150 expert demonstrations daytime (test)
35.7Success Rate
4
CARLA 150 expert demonstrations daytime (test)
70Success Rate
4
CARLA 150 expert demonstrations, daytime (test)
87Success Rate
4
CARLA Town 3 Original Benchmark (test)
100Success Rate
4
CARLA Town 3 NC-Dense (test)
60Success Rate
4
CARLA Town 3 NC-Regular (test)
100Success Rate
4
CARLA
61mIoU
4
CARLA Autonomous Driving Challenge 2019 (Competition)
86.58Route Adherence Points
4
CARLA Simulation (experiment)
96.27Route Points
4
CARLA Town10 behavior-annotated (held-out set)
1,701Latency (ms)
3