CARLA
Benchmarks
TaskDatasetSOTA resultTrendResults
CARLA Town05
35.73Disagreement Score (V0)
20
CARLA Bench2Drive (leaderboard)
87.34Driving Score (DS)
17
CARLA 42 routes
93.25Driving Score
17
CARLA weather town CoRL2017 (test)
100Straight Success
17
CARLA weather CoRL2017 (train)
100Straight Success Rate
17
CARLA Town 2 (test)
21.4AS
15
CARLA (#GP scenario)
9ER
15
CARLA (#HW)
-11Error Rate
15
CARLA Town05 (Long)
73.22DS
15
CARLA Town05 (Short)
95.71DS Score
15
CARLA Town05 Long Benchmark (test)
55.9Driving Score
14
CARLA Town05-Opt (test)
64Route Completion (%)
12
CARLA Town 2 (train)
25.1AS
12
CARLA Town 2 10 unseen (test)
24.32AS Score
12
CARLA New town & weather original (test)
100Straight Driving Success Rate
12
CARLA
65.25Success Rate (SR)
12
CARLA SafeBench (Multiple Regions)
93.3Compliance Ratio (CR)
11
CARLA ADV
37.97mIoU
11
CARLA Longest6 v2 (test)
73Driving Score
11
CARLA Town05 New Weather (test)
88.4Driving Score
10
CARLA 0.9.15 (train test)
83.6SSIM
10
CARLA 0.9.15 (train test)
85.1SSIM
10
CARLA Jun 2022 (public leaderboard)
0.762Driving Score
10
CARLA simulator
99AP@0.5
10
CARLA Town 2 10 routes
17.47Average Speed
9