Habitat
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Habitat Gibson and Matterport3D scenes
86.93Coverage
112
Habitat
98ASR
20
Habitat
98ASR
10
Habitat 3.0c
78Success Rate
6
Habitat Scene 69 1.0 (test)
33Time Found
6
Habitat HM3D (val)
30.59Score
5
Habitat MP3D
23.88Success Rate (SR)
5
Habitat HM3D (val)
45.07Success Rate (SR)
5
Habitat MP3D
78.95Success Rate (SR)
5
Habitat 2020 (test-challenge)
0.102SPL
5
Habitat
450.696FVD
4
Habitat Env. 2 3.0
99Success Rate
4
Habitat Env. 1 3.0
100Success Rate
4
Habitat Open classes
28Top-1 Acc
4
Habitat 15 novel classes
35.4Top-1 Accuracy
4
Habitat 10 base classes
25.8Top-1 Accuracy
4
Habitat Scene 573 1.0 (test)
47Tfind
3
Habitat Scene 871 1.0 (test)
258Tfind
3
Habitat Scene 853 1.0 (test)
345Tfind Score
3
Habitat Pick
82.5Success Rate
3
Habitat 3.0
91Success Rate (S)
2
Habitat Nav
72Success Rate
2
Habitat Rearrange Easy challenge 2.0 (val)
26.4Success Rate
2
Habitat 2.0 (train)
36.7Success Rate
2