# Multiview Based 3D Scene Understanding On Partial Point Sets

Source: [Multiview Based 3D Scene Understanding On Partial Point Sets](<https://www.sota2.com/research/paper/68fa651c1e209131cea086b5>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:19:52.933Z

Authors: Ye Zhu, Sven Ewan Shepstone, Pablo Mart\\'inez-Nuevo, Miklas Str{\\o}m Kristoffersen, Fabien Moutarde, Zhuang Fu

Published: 2018-11-30T12:23:59.000Z

## Abstract

Deep learning within the context of point clouds has gained much research interest in recent years mostly due to the promising results that have been achieved on a number of challenging benchmarks, such as 3D shape recognition and scene semantic segmentation. In many realistic settings however, snapshots of the environment are often taken from a single view, which only contains a partial set of the scene due to the field of view restriction of commodity cameras. 3D scene semantic understanding on partial point clouds is considered as a challenging task. In this work, we propose a processing approach for 3D point cloud data based on a multiview representation of the existing 360{\\deg} point clouds. By fusing the original 360{\\deg} point clouds and their corresponding 3D multiview representations as input data, a neural network is able to recognize partial point sets while improving the general performance on complete point sets, resulting in an overall increase of 31.9% and 4.3% in segmentation accuracy for partial and complete scene semantic understanding, respectively. This method can also be applied in a wider 3D recognition context such as 3D part segmentation.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1812.01712>)

[PDF](<https://arxiv.org/pdf/1812.01712.pdf>)
