Matterport3D
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Matterport3D Indoor
45.9AUC@30
5
Matterport3D (test)
45.15AUC @5°
5
MatterPort3D
5.77MMD (Chair)
5
Matterport3D
5.79AbsRel
4
Matterport3D 18-task suite LENL settings (averaged)
66Average Success Rate
4
Matterport3D 1.0m baseline (test)
0.023LRCE
4
Matterport3D 1.5m baseline (test)
32.5LRCE
4
Matterport3D baseline 2.0m (test)
0.025LRCE
4
Matterport3D
13.6Parameters (M)
4
Matterport3D 1.0m baseline
0.11Absolute Relative Error (AbsRel)
4
Matterport3D 1.5m baseline
17Absolute Relative Error (AbsRel)
4
Matterport3D 2.0m baseline
0.2AbsRel
4
Matterport3D 1.0m baseline
0.903PCC
4
Matterport3D 1.5m baseline
0.856PCC
4
Matterport3D 2.0m baseline
0.821PCC
4
Matterport3D
0.15RMSE (m)
4
Matterport3D (test)
0.001CD1
4
Matterport3D 2 (test)
24.7mAP (21 classes)
4
MatterPort3D (test)
11.1AP
4
MatterPort3D (test)
9.1AP
4
Matterport3D
8.9AP
4
Matterport3D
21.5AP
4
Matterport3D Habitat API (val)
5.658DTS
4
Matterport3D 1.5m threshold (simulation)
5T1st Success
3
Matterport3D simulation 1m threshold
8T1st
3