# LatticeNet: Fast Spatio-Temporal Point Cloud Segmentation Using Permutohedral Lattices

Source: [LatticeNet: Fast Spatio-Temporal Point Cloud Segmentation Using Permutohedral Lattices](<https://www.sota2.com/research/paper/68fa6a901e209131cea28de8>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:09:35.928Z

Authors: Radu Alexandru Rosu, Peer Sch\\"utt, Jan Quenzel, Sven Behnke

Published: 2021-08-09T10:17:27.000Z

## Abstract

Deep convolutional neural networks (CNNs) have shown outstanding performance in the task of semantically segmenting images. Applying the same methods on 3D data still poses challenges due to the heavy memory requirements and the lack of structured data. Here, we propose LatticeNet, a novel approach for 3D semantic segmentation, which takes raw point clouds as input. A PointNet describes the local geometry which we embed into a sparse permutohedral lattice. The lattice allows for fast convolutions while keeping a low memory footprint. Further, we introduce DeformSlice, a novel learned data-dependent interpolation for projecting lattice features back onto the point cloud. We present results of 3D segmentation on multiple datasets where our method achieves state-of-the-art performance. We also extend and evaluate our network for instance and dynamic object segmentation.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2108.03917>)

[PDF](<https://arxiv.org/pdf/2108.03917.pdf>)
