SpatialEval
Benchmarks
TaskDatasetSOTA resultTrendResults
SpatialEval Spatial-Map (20% train)
93.4Accuracy (Spatial-Map)
20
SpatialEval Spatial-Grid (20% train)
92.2Accuracy
20
SpatialEval Maze-Nav 20% (train)
86.2Accuracy
20
SpatialEval (test)
35.2Maze Navigation Acc
16
SpatialEval US Boundaries
97.3PG-PG Topological Accuracy
12
SpatialEval US Boundaries
0.37PG-PG Distance
12
SpatialEval Los Angeles
95.1PT-PL NN Accuracy
12
SpatialEval Los Angeles
543.6PT-PL Distance
12
SpatialEval Beijing
95.7PT-PL NN Accuracy
12
SpatialEval Beijing
393.5PT-PL Distance
12
SpatialEval
70.81Accuracy
12
SpatialEval US Boundaries 1.0 (test)
0.055MAE
10
SpatialEval Los Angeles 1.0 (test)
38.9MAE
10
SpatialEval Los Angeles 1.0 (test)
884.4MAE
10
SpatialEval Beijing 1.0 (test)
60.6MAE
10
SpatialEval Beijing 1.0 (test)
1,050.9MAE
10
SpatialEval Real
68.9Accuracy
10