Surface Normal Estimation on NYU v2 (test)
8.6Mean Angle Distance (MAD)DSN
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DSNMasking=true, Gaussian filter=false2020.10 | 8.6 | 5.5 | 72.2 | 91 | 96.8 | — | — | — | 12.2 | — | — | — | — | — | — | |
| DSNMasking=true, Gaussian filter=true2020.10 | 8.6 | 5.5 | 72.3 | 91 | 96.9 | — | — | — | 12.2 | — | — | — | — | — | — | |
| Metric3D v2Backbone=ViT-L, CSTM configuration=label, Evaluation protocol=Fine-tuned2024.03 | 12 | 6.5 | 68.8 | 84.9 | 89.8 | — | — | — | 19.2 | — | — | — | — | — | — | |
| EDNAS+JAReDMulti-task=true, Search=EDNAS, Loss=JAReD2022.10 | 12.6 | — | 56.1 | 83.9 | 92.4 | — | — | — | — | 20.3 | 12.7 | — | — | — | — | |
| PolymaxEvaluation protocol=Zero-shot2024.03 | 13.1 | 7.1 | 65.6 | 82.2 | 87.8 | — | — | — | 20.4 | — | — | — | — | — | — | |
| Metric3D v2Backbone=ViT-L, CSTM configuration=label, Evaluation protocol=Zero-shot2024.03 | 13.1 | 7.1 | 66.2 | 83.1 | 88.1 | — | — | — | 21.1 | — | — | — | — | — | — | |
| Metric3D v2Backbone=ViT-g, CSTM configuration=label, Evaluation protocol=Fine-tuned2024.03 | 13.2 | 7.5 | 66.2 | 83.7 | 88.9 | — | — | — | 20.2 | — | — | — | — | — | — | |
| Metric3D v2Backbone=ViT-g, CSTM configuration=label, Evaluation protocol=Zero-shot2024.03 | 13.3 | 7 | 66.4 | 83.1 | 88.1 | — | — | — | 21.3 | — | — | — | — | — | — | |
| EDNASMulti-task=true, Search=EDNAS2022.10 | 14.3 | — | 49.5 | 79.2 | 89.4 | — | — | — | — | 11.3 | 9.6 | — | — | — | — | |
| NDDR-CNNBackbone=ResNet-1012018.01 | 14.4 | 11.6 | 48.5 | 79.1 | 89.5 | — | — | — | — | — | — | — | — | — | — | |
| iDiscNotes=same architecture and training pipeline as indoor depth estimation2023.04 | 14.6 | 7.3 | 63.8 | 79.8 | 85.6 | — | — | — | 22.8 | — | — | — | — | — | — | |
| Bae et al.2023.04 | 14.9 | 7.5 | 62.2 | 79.3 | 85.2 | — | — | — | 23.5 | — | — | — | — | — | — | |
| Bae et al.2024.03 | 14.9 | 7.5 | 62.2 | 79.3 | 85.2 | — | — | — | 23.5 | — | — | — | — | — | — | |
| AngMFTraining Dataset=NYUv22021.09 | 14.9 | 7.5 | 62.2 | 79.3 | 85.2 | — | — | — | 23.5 | — | — | — | — | — | — | |
| Sluice networkBackbone=ResNet-1012018.01 | 15.3 | 12.8 | 44.1 | 76.9 | 88.2 | — | — | — | — | — | — | — | — | — | — | |
| Single-task baselineBackbone=ResNet-1012018.01 | 15.6 | 12.7 | 44.3 | 74.8 | 87.2 | — | — | — | — | — | — | — | — | — | — | |
| Cross-stitch networkBackbone=ResNet-1012018.01 | 15.9 | 13.2 | 42.9 | 75.1 | 86.8 | — | — | — | — | — | — | — | — | — | — | |
| Bae et al.Evaluation protocol=Zero-shot2024.03 | 16 | 8.4 | 59.7 | 77.5 | 83.7 | — | — | — | 24.7 | — | — | — | — | — | — | |
| AngMFTraining Dataset=ScanNet, Fine-tuning=false2021.09 | 16 | 8.4 | 59 | 77.5 | 83.7 | — | — | — | 24.7 | — | — | — | — | — | — | |
| TiltedSNEvaluation protocol=Zero-shot2024.03 | 16.1 | 8.1 | 59.8 | 77.4 | 83.4 | — | — | — | 25.1 | — | — | — | — | — | — | |
| TiltedSNTraining Dataset=ScanNet, Fine-tuning=false2021.09 | 16.1 | 8.1 | 59.8 | 77.4 | 83.4 | — | — | — | 25.1 | — | — | — | — | — | — | |
| Multiple-task baselineBackbone=ResNet-1012018.01 | 16.3 | 13.8 | 41.1 | 73.9 | 86.5 | — | — | — | — | — | — | — | — | — | — | |
| MT edge baselineMulti-task=true, Architecture=Edge2022.10 | 16.5 | — | 41.9 | 73 | 85.1 | — | — | — | — | — | — | — | — | — | — | |
| MT baselineMulti-task=true2022.10 | 16.6 | — | 42.5 | 73.2 | 84.6 | — | — | — | — | — | — | — | — | — | — | |
| MTANMulti-task=true2022.10 | 16.6 | — | 43.7 | 73.3 | 84.4 | — | — | — | — | 0.7 | 0.4 | — | — | — | — | |
| AdaShareMulti-task=true2022.10 | 16.6 | — | 45 | 71.7 | 83 | — | — | — | — | 0.5 | 8.9 | — | — | — | — | |
| OmnidataEvaluation protocol=Zero-shot2024.03 | 16.7 | 9.6 | 57.7 | 77.7 | 83.8 | — | — | — | 25 | — | — | — | — | — | — | |
| Joint Surface Normal and Semantic Labeling ModelEvaluation Protocol=Standard Normals [14]2019.06 | 17 | — | 48.9 | 72.3 | 81.2 | — | — | — | 30.2 | — | — | — | — | — | — | |
| NDDR-CNNMulti-task=true2022.10 | 17.1 | — | 37.4 | 73.7 | 85.6 | — | — | — | — | -3.3 | -8.3 | — | — | — | — | |
| DENMulti-task=true2022.10 | 17.1 | — | 36 | 73.4 | 85.9 | — | — | — | — | -4.1 | -19.2 | — | — | — | — | |
| Cross-StitchMulti-task=true2022.10 | 17.2 | — | 41.4 | 70.5 | 82.9 | — | — | — | — | -3 | 0 | — | — | — | — | |
| SluiceMulti-task=true2022.10 | 17.2 | — | 38.9 | 71.8 | 83.9 | — | — | — | — | -3.7 | -2.3 | — | — | — | — | |
| VPLNetEvaluation protocol=Zero-shot2024.03 | 18 | 9.8 | 54.3 | 73.8 | 80.7 | — | — | — | — | — | — | — | — | — | — | |
| VPLNetTraining Dataset=ScanNet, Fine-tuning=false2021.09 | 18 | 9.8 | 54.3 | 73.8 | 80.7 | — | — | — | — | — | — | — | — | — | — | |
| GeoNet++2023.04 | 18.5 | 11.2 | 50.2 | 73.2 | 80.7 | — | — | — | 26.7 | — | — | — | — | — | — | |
| GeoNet++2024.03 | 18.5 | 11.2 | 50.2 | 73.2 | 80.7 | — | — | — | 26.7 | — | — | — | — | — | — | |
| GeoNet++Training Dataset=NYUv22021.09 | 18.5 | 11.2 | 50.2 | 73.2 | 80.7 | — | — | — | 26.7 | — | — | — | — | — | — | |
| PAP2020.10 | 18.6 | 11.7 | 48.8 | 72.2 | 79.8 | — | — | — | 25.5 | — | — | — | — | — | — | |
| PAP2023.04 | 18.6 | 11.7 | 48.8 | 72.2 | 79.8 | — | — | — | 25.5 | — | — | — | — | — | — | |
| PAP2024.03 | 18.6 | 11.7 | 48.8 | 72.2 | 79.8 | — | — | — | 25.5 | — | — | — | — | — | — | |
| FrameNetEvaluation protocol=Zero-shot2024.03 | 18.6 | 11 | 50.7 | 72 | 79.5 | — | — | — | 26.8 | — | — | — | — | — | — | |
| PAPTraining Dataset=NYUv22021.09 | 18.6 | 11.7 | 48.8 | 72.2 | 79.8 | — | — | — | 25.5 | — | — | — | — | — | — | |
| FrameNetTraining Dataset=ScanNet, Fine-tuning=false2021.09 | 18.6 | 11 | 50.7 | 72 | 79.5 | — | — | — | 26.8 | — | — | — | — | — | — | |
| DSNMasking=false, Gaussian filter=false2020.10 | 18.7 | 6.9 | 63.2 | 79.7 | 84.8 | — | — | — | 33.7 | — | — | — | — | — | — | |
| DSNMasking=false, Gaussian filter=true2020.10 | 18.7 | 6.8 | 63.3 | 79.7 | 84.8 | — | — | — | 33.7 | — | — | — | — | — | — | |
| Method [19]2019.06 | 19 | — | 48.4 | 71.5 | 79.5 | — | — | — | 26.9 | — | — | — | — | — | — | |
| Qi et al.2020.10 | 19 | 11.8 | 48.4 | 71.5 | 79.5 | — | — | — | 26.9 | — | — | — | — | — | — | |
| GeoNet2023.04 | 19 | 11.8 | 48.4 | 48.4 | 79.5 | — | — | — | 26.9 | — | — | — | — | — | — | |
| GeoNet2024.03 | 19 | 11.8 | 48.4 | 71.5 | 79.5 | — | — | — | 26.9 | — | — | — | — | — | — | |
| GeoNetTraining Dataset=NYUv22021.09 | 19 | 11.8 | 48.4 | 71.5 | 79.5 | — | — | — | 26.9 | — | — | — | — | — | — | |
| InvPT2022.03 | 19.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SkipNet2020.10 | 19.8 | 12 | 47.9 | 70 | 77.8 | — | — | — | 28.2 | — | — | — | — | — | — | |
| SkipNet2024.03 | 19.8 | 12 | 47.9 | 70 | 77.8 | — | — | — | 28.2 | — | — | — | — | — | — | |
| SkipNetTraining Dataset=NYUv22021.09 | 19.8 | 12 | 47.9 | 70 | 77.8 | — | — | — | 28.2 | — | — | — | — | — | — | |
| ATRC2022.03 | 20.18 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MTI-Net2022.03 | 20.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ATRCBackbone=HRNet18, FPM=false2021.04 | 20.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ATRCBackbone=HRNet18, FPM=true2021.04 | 20.51 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MTI-NetBackbone=HRNet18, FPM=true2021.04 | 20.57 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Method [3]2019.06 | 20.6 | — | 44.9 | 67.7 | 76.3 | — | — | — | — | — | — | — | — | — | — | |
| Method [26]2019.06 | 20.6 | — | 47.3 | 68.9 | 76.6 | — | — | — | — | — | — | — | — | — | — | |
| SURGE2020.10 | 20.6 | 12.2 | 47.3 | 68.9 | 76.6 | — | — | — | — | — | — | — | — | — | — | |
| SURGE2023.04 | 20.6 | 12.2 | 47.3 | 68.9 | 76.6 | — | — | — | — | — | — | — | — | — | — | |
| SURGE2024.03 | 20.6 | 12.2 | 47.3 | 68.9 | 76.6 | — | — | — | — | — | — | — | — | — | — | |
| SURGETraining Dataset=NYUv22021.09 | 20.6 | 12.2 | 47.3 | 68.9 | 76.6 | — | — | — | — | — | — | — | — | — | — | |
| PAP2022.03 | 20.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PAD-Net2022.03 | 20.85 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PSD2022.03 | 20.87 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-Stitch2022.03 | 20.88 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Multiscale Convolutional NetworkBackbone=VGG2014.11 | 20.9 | 13.2 | 44.4 | 67.2 | 75.9 | — | — | — | — | — | — | — | — | — | — | |
| Deep3D2024.03 | 20.9 | 13.2 | 42 | 61.2 | 68.2 | — | — | — | — | — | — | — | — | — | — | |
| Eigen et al.2024.03 | 20.9 | 13.2 | 44.4 | 67.2 | 75.9 | — | — | — | — | — | — | — | — | — | — | |
| Eigen et al.Training Dataset=NYUv22021.09 | 20.9 | 13.2 | 44.4 | 67.2 | 75.9 | — | — | — | — | — | — | — | — | — | — | |
| Single taskBackbone=HRNet18, FPM=false2021.04 | 20.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Multi-taskBackbone=HRNet18, FPM=false2021.04 | 21.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ForkMerge2023.01 | 22.18 | 15.6 | 37.93 | 64.29 | 74.81 | — | — | — | — | — | — | — | 4.03 | — | — | |
| ForkMerge2023.01 | 22.18 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Multiscale Convolutional NetworkBackbone=VGG2014.11 | 22.2 | 15.3 | 38.6 | 64 | 73.9 | — | — | — | — | — | — | — | — | — | — | |
| MGDA2023.05 | 22.34 | 15.7 | 37.71 | 63.96 | 74.5 | — | — | — | — | — | — | — | — | — | — | |
| STL2023.01 | 22.82 | 16.23 | 36.58 | 62.75 | 73.52 | — | — | — | — | — | — | — | — | — | — | |
| STL2023.01 | 22.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Post-train2023.01 | 22.98 | 16.48 | 36.04 | 62.27 | 73.2 | — | — | — | — | — | — | — | 1.49 | — | — | |
| Post-train2023.01 | 22.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MGDA2023.01 | 23.14 | 16.46 | 36.15 | 62.17 | 72.97 | — | — | — | — | — | — | — | 1.44 | — | — | |
| MGDA2023.01 | 23.14 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FEDHCA2Client Setup=Single-Task2023.11 | 23.19 | — | — | — | — | — | — | — | — | — | — | — | — | 0.75 | — | |
| NashMTL2023.01 | 23.21 | 16.74 | 35.39 | 61.8 | 72.92 | — | — | — | — | — | — | — | 1.11 | — | — | |
| NashMTL2023.01 | 23.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LocalClient Setup=Single-Task2023.11 | 23.22 | — | — | — | — | — | — | — | — | — | — | — | — | 0 | — | |
| IMTL2023.01 | 23.25 | 16.64 | 35.86 | 61.81 | 72.73 | — | — | — | — | — | — | — | 2.1 | — | — | |
| IMTL2023.01 | 23.25 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FedAMPClient Setup=Single-Task2023.11 | 23.31 | — | — | — | — | — | — | — | — | — | — | — | — | 0.27 | — | |
| Auto-λ2023.01 | 23.38 | 17.2 | 34.05 | 61.18 | 72.05 | — | — | — | — | — | — | — | 1.17 | — | — | |
| Auto-λ2023.01 | 23.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAGrad2023.01 | 23.39 | 16.89 | 35.35 | 61.28 | 72.42 | — | — | — | — | — | — | — | 1.41 | — | — | |
| CAGrad2023.01 | 23.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MaT-FLClient Setup=Single-Task2023.11 | 23.39 | — | — | — | — | — | — | — | — | — | — | — | — | -0.16 | — | |
| MoDo2023.05 | 23.45 | 17.09 | 34.79 | 60.9 | 72.12 | — | — | — | — | — | — | — | — | — | — | |
| Multiscale Convolutional NetworkBackbone=AlexNet2014.11 | 23.7 | 15.5 | 39.2 | 62 | 71.1 | — | — | — | — | — | — | — | — | — | — | |
| Eigen et al.Supervised=true, Source=Predicted from Network2020.07 | 23.7 | — | 39.2 | 62 | 71.1 | — | — | — | — | — | — | — | — | — | — |