Semantic Segmentation on ScanNet++ (val)
52.9mIoUChorus
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ChorusEvaluation Protocol=fine-tuned2025.12 | 52.9 | 66.2 | 87.1 | — | |
| ConcertoLearnable Parameters=124.8M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 50.7 | 63.3 | 87.9 | — | |
| ConcertoLearnable Parameters=124.8M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 50.7 | 63.3 | — | 87.9 | |
| SonataEvaluation Protocol=fine-tuned2025.12 | 49.9 | 60.7 | 87.4 | — | |
| SonataLearnable Parameters=124.8M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 49.3 | 62.4 | 87.6 | — | |
| SonataLearnable Parameters=124.8M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 49.3 | 62.4 | — | 87.6 | |
| ChorusEvaluation Protocol=linear probing2025.12 | 48.8 | 63.2 | 86.4 | — | |
| G2P2026.01 | 48.7 | 60.1 | 90 | — | |
| MSCEvaluation Protocol=fine-tuned2025.12 | 48.7 | 61.9 | 87.2 | — | |
| MSCLearnable Parameters=124.8M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 48.7 | 61.9 | 87.2 | — | |
| MSCLearnable Parameters=124.8M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 48.7 | 61.9 | — | 87.2 | |
| ChorusEvaluation Protocol=decoder2025.12 | 48.4 | 62.3 | 86.7 | — | |
| PTv3Evaluation Protocol=supervised2025.12 | 48.2 | 61.6 | 87 | — | |
| PTv3Learnable Parameters=124.8M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 48.2 | 61.6 | 87 | — | |
| PTv3Learnable Parameters=124.8M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 48.2 | 61.6 | — | 87 | |
| PT v3status=reproduced2026.01 | 47.9 | 59.1 | 90 | — | |
| SonataEvaluation Protocol=decoder2025.12 | 46.6 | 58.9 | 86.8 | — | |
| PTv3-PPTPTv3 Variant=PPT, Training Data=ScanNet200 + ScanNet++ + Structure3Dv2, Data Size=458682024.10 | 45.3 | — | — | — | |
| PTv3-PPTPTv3 Variant=PPT, Training Data=ScanNet + ScanNet200 + ScanNet++ + Structure3D + ARKit LabelMaker, Data Size=303862024.10 | 44.6 | — | — | — | |
| PTv3-PPTPTv3 Variant=PPT, Training Data=ScanNet200 + ScanNet++ + ARKit LabelMaker, Data Size=111682024.10 | 44.5 | — | — | — | |
| PTv3 (fine-tune)PTv3 Variant=fine-tune, Training Data=ARKit LabelMaker SN200 -> ScanNet++, Data Size=4471 -> 7132024.10 | 42.5 | — | — | — | |
| PTv3 (vanilla)PTv3 Variant=vanilla, Training Data=ScanNet++, Data Size=7132024.10 | 41.8 | — | — | — | |
| SonataEvaluation Protocol=linear probing2025.12 | 40.7 | 55.3 | 84.8 | — | |
| MSCLearnable Parameters=39.2M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 39.4 | 49.6 | 84.9 | — | |
| MSCLearnable Parameters=39.2M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 39.4 | 49.6 | — | 84.9 | |
| CSCLearnable Parameters=39.2M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 32.5 | 41.1 | 83.7 | — | |
| CSCLearnable Parameters=39.2M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 32.5 | 41.1 | — | 83.7 | |
| PCLearnable Parameters=39.2M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 29.2 | 39.7 | 82.7 | — | |
| PCLearnable Parameters=39.2M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 29.2 | 39.7 | — | 82.7 | |
| SparseUNetLearnable Parameters=39.2M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 28.8 | 38.4 | 80.1 | — | |
| SparseUNetLearnable Parameters=39.2M, Percentage of Parameters=100%, Fine-tuning Protocol=Full fine-tuning2025.10 | 28.8 | 38.4 | — | 80.1 | |
| MSCEvaluation Protocol=linear probing2025.12 | 8.1 | 11.9 | 64.7 | — |