CARLA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CARLA Town13 2.0 (train)
71.82Route Completion
3
CARLA Town13 2.0 (val)
83.4Route Completion Rate
3
CARLA Towns 01-03 Total Normal
2.7Route Completion
3
CARLA Towns 01-03 Total Challenging
2.38Route Completion
3
CARLA Town 03 Challenging
68Route Completion
3
CARLA Town 02 Normal
91Route Completion
3
CARLA Town 02 Challenging
77Route Completion
3
CARLA Town 01 (Challenging)
93Route Completion
3
CARLA Town02 & Town05
66.7DS
3
CARLA (test)
1.08Mean Rotation Error
3
CARLA
29.3FID
3
CARLA
29.2FID
3
CARLA Town05 Long (Without New Weather)
73.2Driving Score
2
CARLA Town03 Night
91.5Success Rate
2
CARLA Town02 Night
94.2Success Rate
2
CARLA Town03 Fog
93.8Success Rate
2
CARLA Fog (Town02)
96.5Success Rate
2
CARLA Traffic Manager (test)
76Success Rate (SR)
2
CARLA Longest6 Town5
53.7Driving Score (DS)
2
CARLA Longest6 Town1
84.3DS
2
CARLA (outdoor environment (Town01-04 as seen, Town05, 06 as unseen))
47.49SR
2
Carla (test)
31.13FID
2
Carla Cars (test)
1.98Editing Time (s)
2
Carla Cars (test)
2.12Editing Time (s)
2
CARLA No shift
1Route Completion (RC)
1