Matterport3D
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Matterport3D official (test)
0.839Overall 2D IoU
11
Matterport3D Studio scene
16.08Steps
10
Matterport3D
87.8MMA@3
10
Matterport3D 4
48.43mIoU
10
Matterport3D
91.7Delta 1 Acc
9
Matterport3D 4 (test)
67.2mIoU
9
Matterport3D (Unseen environments)
1.22STFT
9
Matterport3D (Seen environments)
1.1STFT
9
Matterport3D 2K resolution (2048x1024) (test)
0.2AbsRel
9
Matterport3D (val)
33.33Acc@0.25
8
Matterport3D Indoor (test)
0.067AbsRel
8
Matterport3D 160 classes (test)
18.7f-mIoU
8
Matterport3D
29.78IoU
8
Matterport3D
29.11IoU
8
Matterport3D
83.912D IoU
8
Matterport3D (MP3D) Hard Habitat with VisFly simulator (test)
55Success Rate
7
Matterport3D (MP3D) Medium Habitat with VisFly simulator (test)
69SR
7
Matterport3D (MP3D) Easy Habitat with VisFly simulator (test)
89Success Rate
7
Matterport3D
55.7mIoU
7
Matterport3D
17.19PSNR
7
Matterport3D 160
23.6mIoU
7
Matterport3D Zero-shot Generalization (test)
57DAc@0.5
7
Matterport3D NYU Classes Top-160 (test)
26mAcc
7
Matterport3D Top-80 NYU Classes (test)
38.2mAcc
7
Matterport3D Top-40 NYU Classes (test)
53.6mAcc
7