HM3D
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HM3D v1 (test)
60.5Success Rate (SR)
17
HM3D OVON (test)
50.2SR
17
HM3D (test)
80Success Rate
16
HM3D (val)
74.94Completeness
15
HM3D ObjNav (val)
77.3SR
15
HM3D v3 (val)
78.5Success Rate (SR)
15
HM3D supervised (test)
0RRE
15
HM3D v1
60.2SR
14
HM3D OVON
54.9SR
14
HM3D Challenge (test)
65Success Rate
14
HM3D Standard (test)
68Success Rate
14
HM3D 1000 episodes
64.7Success Rate (SR)
13
HM3D OVON v1 (val unseen)
51SR
12
HM3D v1
80SR
12
HM3D (test)
1ND
12
HM3D v2 (test)
76.2Success Rate (SR)
11
HM3D v0.2 (val)
77Success Rate (SR)
10
HM3D Scene 69 Habitat (val)
0.631F1 Score
9
HM3D Scene 871 Habitat (val)
68F1 Score
9
HM3D Scene 853 Habitat (val)
66.7F1 Score
9
HM3D Scene 573 Habitat (val)
68.7F1 Score
9
HM3D v0.1 (val)
70.4Success Rate (SR)
9
HM3D (val)
82.6Success Rate
9
HM3D Shortcut v3
60.95Success Rate (SR)
9
HM3D Alt Goal v3
34.26SR
9