CARLA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CARLA
5.82CD (Avg Class)
6
CARLA New Town original
1Success Rate Straight
6
CARLA Training conditions original (train)
100Straight Success
6
CARLA Domain shift - Case 6
92.23Route Completion (RC)
5
CARLA Sensor shift - Case 5
100Route Completion Rate (RC)
5
CARLA Minimal shift - Case 1
100Route Completion (RC)
5
CARLA 9 routes across 3 scenes
75.55Success Rate (SR)
5
CARLA Town02
100Success Rate
5
CARLA Town01
100Success Rate
5
CARLA LongTail
61.3Occ-Track
5
CARLA-LongTail
71.4mAP
5
CARLA-FlowGuided
0.47Keypoint Offset (px)
5
CARLA Vehicles (27 vehicles) (in-distribution)
80.27Average Driving Score (DS)
5
CARLA Unseen Maps - Pedestrians
18.35ATF (Close)
5
CARLA Unseen Maps - Vehicles
83.49ATF (Close Range)
5
CARLA Seen Maps (Town02, Town05, Town06, Town07, Town10HD)
25.67Close ATF (Veh)
5
Carla zero-shot transfer from Waymo original-view (test)
6.01RMSE (Static)
5
Carla original-view
22.37PSNR (Dynamic Only)
5
CARLA Town 4
19.48Average Speed (AS)
5
CARLA Town 3
16.78AS (Average Score)
5
CARLA (test)
93.85AUC
5
CARLA Town07 (unseen routes)
0.495Success Rate
5
CARLA Town04 (unseen routes)
617Success Rate
5
CARLA 2023 Grand Prix Metaverse AD Challenge
265.65Lap Time (s)
5
CARLA generated dataset (test)
100Accuracy
5