3D Semantic Segmentation on SemanticKITTI-FV (val)
0.668mIoU2DPASS
Evaluation Results
| Method | Links | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2DPASSModality=Fusion-based2021.06 | 0.668 | 0.966 | 0.608 | 0.716 | 0.82 | 0.778 | 0.782 | 0.92 | 0.002 | 0.939 | 0.444 | 0.757 | 0.031 | 0.895 | 0.609 | 0.887 | 0.726 | 0.74 | 0.615 | 0.455 | |
| EPMFModality=Fusion-based2021.06 | 0.659 | 0.954 | 0.525 | 0.663 | 0.824 | 0.805 | 0.772 | 0.851 | 0 | 0.958 | 0.481 | 0.805 | 0.008 | 0.892 | 0.661 | 0.86 | 0.7 | 0.689 | 0.626 | 0.436 | |
| Cylinder3DModality=LiDAR-only2021.06 | 0.649 | 0.964 | 0.615 | 0.782 | 0.663 | 0.698 | 0.808 | 0.933 | 0 | 0.949 | 0.415 | 0.78 | 0.014 | 0.875 | 0.5 | 0.867 | 0.722 | 0.688 | 0.63 | 0.421 | |
| PMFModality=Fusion-based2021.06 | 0.639 | 0.954 | 0.478 | 0.629 | 0.684 | 0.752 | 0.789 | 0.716 | 0 | 0.964 | 0.435 | 0.805 | 0.001 | 0.887 | 0.601 | 0.886 | 0.727 | 0.753 | 0.655 | 0.43 | |
| SPVNASModality=LiDAR-only2021.06 | 0.623 | 0.965 | 0.448 | 0.631 | 0.599 | 0.643 | 0.72 | 0.86 | 0 | 0.939 | 0.424 | 0.759 | 0 | 0.888 | 0.591 | 0.88 | 0.675 | 0.73 | 0.635 | 0.443 | |
| 2DPASSModality=Fusion-based, trained under our settings=true2021.06 | 0.618 | 0.936 | 0.549 | 0.716 | 0.816 | 0.435 | 0.715 | 0.822 | 0.002 | 0.94 | 0.338 | 0.751 | 0.002 | 0.887 | 0.573 | 0.885 | 0.671 | 0.751 | 0.56 | 0.402 | |
| SalsaNextModality=LiDAR-only2021.06 | 0.594 | 0.905 | 0.446 | 0.496 | 0.863 | 0.546 | 0.74 | 0.814 | 0 | 0.934 | 0.406 | 0.691 | 0 | 0.846 | 0.53 | 0.836 | 0.643 | 0.642 | 0.544 | 0.398 | |
| Uni-modal baselineModality=LiDAR-only2021.06 | 0.586 | 0.932 | 0.359 | 0.339 | 0.782 | 0.544 | 0.631 | 0.719 | 0 | 0.95 | 0.424 | 0.8 | 0.007 | 0.86 | 0.537 | 0.861 | 0.635 | 0.737 | 0.594 | 0.419 | |
| MinkowskiNetModality=LiDAR-only2021.06 | 0.585 | 0.95 | 0.239 | 0.504 | 0.553 | 0.459 | 0.656 | 0.822 | 0 | 0.943 | 0.437 | 0.764 | 0 | 0.879 | 0.576 | 0.874 | 0.677 | 0.715 | 0.635 | 0.436 | |
| RGBALModality=Fusion-based, our implementation=true2021.06 | 0.562 | 0.873 | 0.361 | 0.264 | 0.646 | 0.546 | 0.581 | 0.727 | 0 | 0.951 | 0.456 | 0.775 | 0.008 | 0.789 | 0.534 | 0.843 | 0.617 | 0.729 | 0.561 | 0.415 | |
| PointPaintingModality=Fusion-based, our implementation=true2021.06 | 0.545 | 0.947 | 0.177 | 0.35 | 0.288 | 0.55 | 0.594 | 0.636 | 0 | 0.953 | 0.399 | 0.776 | 0.004 | 0.875 | 0.551 | 0.877 | 0.67 | 0.729 | 0.618 | 0.365 | |
| SequeezeSegV3Modality=LiDAR-only2021.06 | 0.533 | 0.871 | 0.343 | 0.486 | 0.475 | 0.471 | 0.581 | 0.538 | 0 | 0.953 | 0.431 | 0.782 | 0.003 | 0.789 | 0.532 | 0.823 | 0.555 | 0.704 | 0.463 | 0.332 | |
| RangeNet++Modality=LiDAR-only2021.06 | 0.512 | 0.894 | 0.265 | 0.484 | 0.339 | 0.267 | 0.548 | 0.694 | 0 | 0.929 | 0.37 | 0.699 | 0 | 0.834 | 0.51 | 0.833 | 0.54 | 0.681 | 0.498 | 0.34 | |
| RandLANetModality=LiDAR-only2021.06 | 0.5 | 0.92 | 0.08 | 0.128 | 0.748 | 0.467 | 0.523 | 0.46 | 0 | 0.934 | 0.327 | 0.734 | 0.001 | 0.84 | 0.435 | 0.837 | 0.573 | 0.731 | 0.48 | 0.273 | |
| SequeezeSegV2Modality=LiDAR-only2021.06 | 0.408 | 0.827 | 0.151 | 0.227 | 0.256 | 0.269 | 0.229 | 0.445 | 0 | 0.927 | 0.397 | 0.707 | 0.001 | 0.716 | 0.37 | 0.746 | 0.358 | 0.681 | 0.218 | 0.222 |