Semantic Segmentation on SemanticKITTI multiple scans (test)
63.4mIoULSK3DNet
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LSK3DNetInput=PV2024.03 | 63.4 | 92.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.4 | 69.9 | 84.4 | 7.2 | 4,090 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| 2DPASSInput=Multiple scans2022.07 | 62.4 | 91.4 | 96.2 | 82.1 | 48.2 | 16.1 | 52.7 | 3.8 | 35.4 | 80.3 | 7.9 | 71.2 | 62 | 73.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| 2DPASSInput=PV2024.03 | 62.4 | 91.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.3 | 71.2 | 82.1 | 16.1 | 380 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| (AF)2-S3NetInput=Multiple scans2022.07 | 56.9 | 88.1 | 91.8 | 65.3 | 15.7 | 5.6 | 27.5 | 3.9 | 16.4 | 67.6 | 15.1 | 66.4 | 67.1 | 59.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| (AF)2-S3NetInput=V2024.03 | 56.9 | 88.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.6 | 66.4 | 65.3 | 5.6 | 390 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MarS3DBackbone=SPVCNN2023.07 | 52.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | 95.1 | 49.2 | 49.5 | 39.7 | 36.6 | 16.2 | 1.2 | 0 | 89.9 | 66.8 | 74.3 | 26.4 | 92.1 | 68.2 | 86 | 72.1 | 70.5 | 62.8 | 64.8 | 78.4 | 67.3 | 58 | 36.3 | 10 | 5.1 | |
| Cylinder3DInput=Multiple scans2022.07 | 52.5 | 91 | 94.6 | 74.9 | 41.3 | 0 | 38.8 | 0.1 | 12.5 | 65.7 | 1.7 | 68.3 | 0.2 | 11.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cylinder3DInput=V2024.03 | 52.5 | 91 | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.7 | 68.3 | 74.9 | 0 | 10 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KPConvInput=Multiple scans2022.07 | 51.2 | 89.3 | 93.7 | 69.4 | 42.5 | 5.8 | 38.6 | 4.7 | 21.6 | 67.5 | 0 | 67.4 | 0 | 47.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KPConv2023.07 | 51.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | 93.7 | 44.9 | 47.2 | 43.5 | 38.6 | 21.6 | 0 | 0 | 86.5 | 58.4 | 70.5 | 26.7 | 90.8 | 64.5 | 84.6 | 70.3 | 66 | 57 | 53.9 | 69.4 | 67.4 | 67.5 | 47.2 | 4.7 | 5.8 | |
| KPConvInput=P2024.03 | 51.2 | 89.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.5 | 67.4 | 69.4 | 5.8 | 470 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Meta-RangeSeg2023.07 | 49.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | 90.1 | 52.7 | 43.9 | 30.3 | 35.4 | 14.3 | 0 | 0 | 90.7 | 63.3 | 74.7 | 26.9 | 90.5 | 63.5 | 83 | 67 | 67.7 | 56.4 | 64.4 | 64.5 | 56.1 | 55 | 24.4 | 20.3 | 3.4 | |
| BaselineBackbone=SPVCNN2023.07 | 49.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | 89.8 | 39.4 | 34 | 39.4 | 21 | 8.9 | 1.8 | 0 | 89.1 | 62 | 72.4 | 12.9 | 90.5 | 63.9 | 84.6 | 68.4 | 68.7 | 58.9 | 60.1 | 69.3 | 63.5 | 58.7 | 56.5 | 9.5 | 3.6 | |
| TemporalLatticeNet2023.07 | 47.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | 91.6 | 35.4 | 36.1 | 26.9 | 23 | 9.4 | 0 | 0 | 91.5 | 59.3 | 75.3 | 27.5 | 89.6 | 65.3 | 84.6 | 66.7 | 70.4 | 57.2 | 60.4 | 59.7 | 41.7 | 51 | 48.8 | 5.9 | 0 | |
| TemporalLidarSegInput=Multiple scans2022.07 | 47 | 89.6 | 92.1 | 68.2 | 39.2 | 2.1 | 35 | 12.4 | 14.4 | 40.4 | 0 | 42.8 | 0 | 12.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TemporalLidarSeg2023.07 | 47 | — | — | — | — | — | — | — | — | — | — | — | — | — | 92.1 | 47.7 | 40.9 | 39.2 | 35 | 14.4 | 0 | 0 | 91.8 | 59.6 | 75.8 | 23.2 | 89.8 | 63.8 | 82.3 | 62.5 | 64.7 | 52.6 | 60.4 | 68.2 | 42.8 | 40.4 | 12.9 | 12.4 | 2.1 | |
| TLSegInput=R2024.03 | 47 | 89.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | 40.4 | 42.8 | 68.2 | 2.1 | 1,240 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LatticeNetInput=Multiple scans2022.07 | 45.2 | 89.3 | 91.1 | 54.8 | 29.7 | 3.5 | 23.1 | 0.6 | 6.8 | 49.9 | 0 | 44.6 | 0 | 64.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LatticeNetInput=P2024.03 | 45.2 | 89.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | 49.9 | 44.6 | 54.8 | 3.5 | 60 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SpSequenceNet2023.07 | 43.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | 88.5 | 24 | 26.2 | 29.2 | 22.7 | 6.3 | 0 | 0 | 90.1 | 57.9 | 73.9 | 27.1 | 91.2 | 66.8 | 84 | 66 | 65.7 | 50.8 | 48.7 | 53.2 | 41.2 | 26.2 | 36.2 | 2.3 | 0.1 |