CityNav
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CityNav seen (val)
9.1Navigation Error (NE)
14
CityNav unseen (val)
9.4Navigation Error (NE)
14
CityNav (test unseen)
9.8Navigation Error (NE)
14
CityNav Unseen (test)
45.73NE
13
CityNav Sao Paulo 1.0
29Success
12
CityNav Vienna 1.0
56Success
12
CityNav Tokyo 1.0
0.3Success Rate
12
CityNav New York 1.0
95Success Rate
12
CityNav Unseen (test)
9.8NE
11
CityNav Unseen (val)
9.4Navigation Error
11
CityNav seen (val)
9.1Navigation Error (NE)
11
CityNav Unseen Original Refined (test)
9.8NE
8
CityNav Original Refined (val Unseen)
9.4Navigation Error (NE)
8
CityNav Seen Original Refined (val)
9.1Navigation Error (NE)
8
CityNav (val Unseen)
63.11Navigation Error (NE)
7
CityNav (val Seen)
59.41Navigation Error (NE)
7
CityNav Hard
58.96Navigation Error (NE)
6
CityNav Medium
51.51Navigation Error (Path Length)
6
CityNav Easy
47.75Navigation Error (NE)
6
CityNav
0.86ADE (m)
5
CityNav Seen Hard difficulty (val)
68.9NE
5
CityNav Seen Medium difficulty (val)
53.8Navigation Error (NE)
5
CityNav Easy difficulty (val Seen)
53.89Navigation Error (NE)
5