CARLA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CARLA 42 Routes v1 (internal evaluation)
86.05Route Completion (RC)
9
CARLA Leaderboard
2,237.31Return
9
Carla Official Town13 (devtest)
56.8DS
9
CARLA noise-free (test)
0.754MAE
9
CARLA 128 x 128 (test)
6.7FID
9
CARLA longest6 v2 (test)
39.89DS Score
8
CARLA 1.0 (New weather)
0.09Opposite Lane Infractions
8
CARLA 1.0 (train conditions)
0.18Opposite Lane Infractions
8
CARLA (ca)
0.091AbsRel
8
CARLA
0.836SSIM
8
CARLA
85.1SSIM
8
CARLA OOD
25.85FPR@95
8
CARLA
14.3Collision Rate
8
CARLA (out-of-path)
26.23PSNR
8
CARLA Town05 Long 1.0 (test)
40.37Driving Score (DS)
8
CARLA Town05 Short 1.0 (test)
66.95DS
8
CARLA
1.4MACs (G)
8
CARLA Town01
117FVD
8
CARLA public leaderboard Jan 2022 (online)
61.85Driving Score
8
CARLA leaderboard Jan 2022 (test)
61.85Driving Score
8
CARLA
0.47Chamfer Distance (All)
8
CARLA 220 short routes Leaderboard v2 protocol
65.89Driving Score (DS)
7
CARLA 220 short routes Leaderboard v2 protocol
0.73Open-loop L2 Error
7
CARLA Town01 & Town02
96.43Town01 SR
7
CARLA HW scenario
316Episode Reward
7