HM3D
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HM3D v0.2
74.6Success Rate (Predicted Semantics)
3
HM3D (1000 episodes)
68.1Success Rate (SR)
3
HM3D
56.87Success Rate (SR)
3
HM3D Habitat (test)
69Environment Revealed Proportion
3
HM3DSem-SQR Chained (Type E)
72.22QLCR
3
HM3D 1.0 (test)
0.053Abs Diff
3
HM3D
0.049Accuracy (m)
3
HM3D
93.3RRE
3
HM3D v2 (Semantics v0.2) (test)
75.6Success Rate (SR)
2
HM3D IIN
62.6SPL
2
HM3D Average across 6 maps
23,325.8Coverage-Distance AUC
2
HM3D Map 804
19,583.8Coverage-Distance AUC
2
HM3D Map 666
17,017.5Coverage-Distance AUC
2
HM3D Map 417
27,124.8Coverage-Distance AUC
2
HM3D Map 231
13,797.1Coverage-Distance AUC
2
HM3D Map 195
37,124.3Coverage-Distance AUC
2
HM3D Map 130
24,447.1Coverage-Distance AUC
2
HM3D 21 (test)
93Accuracy
2
HM3D temporal-change
42.9Success Rate (SR)
2
HM3DSem
97.88SR (s=1.0m)
2
HM3DSem
70.6Semantic Accuracy (Random)
1