HM3D
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HM3D Habitat 2.0 (test)
72.6Success Rate (SR)
9
HM3D challenge
38.8SR
9
HM3D Habitat 2022 ObjectNav challenge (val)
54.4Success Rate (SR)
9
HM3D-ObjNav unseen indoor scenes MSGNav protocol
82.6Success Rate (SR)
8
HM3D-OVON (Unseen)
54Success Rate (SR)
8
HM3D-OVON
60Success Rate (SR)
8
HM3D manually annotated (test)
25.86BLEU-4
8
HM3D Habitat (val)
0.82Kendall's Tau (20 steps)
8
HM3D
0.81Kendall Tau (20 steps)
8
HM3D Instance ImageNav (test)
60.8SR
8
HM3D Semantics v1 v0.1 (test)
73.7Success Rate (SR)
7
HM3D v0.2 (val)
85Success Rate (SR)
7
HM3D challenge
70.2Success Rate (SR)
7
HM3D 2.5k episodes
33.4SCT
6
HM3D 4-cam
95.6mAA@30
6
HM3D 8-cam
97.1mAA@30
6
HM3D 4-camera rig
0.061Translation Error (m)
6
HM3D 8-camera rig
0.068Translation Error (m)
6
HM3D
52.79SPL
6
HM3D
30SPL
6
HM3D
46.15SPL
6
HM3D
47.83SPL
6
HM3D
93.94SPL
6
HM3D-SEM (test)
83R-RSR
6
HM3D
0.105AbsRel
5