# Spatial-Temporal Transformer for 3D Point Cloud Sequences

Source: [Spatial-Temporal Transformer for 3D Point Cloud Sequences](<https://www.sota2.com/research/paper/68fa6b0c1e209131cea2bb28>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:38:16.503Z

Authors: Yimin Wei, Hao Liu, Tingting Xie, Qiuhong Ke, Yulan Guo

Published: 2021-10-19T07:55:47.000Z

## Abstract

Effective learning of spatial-temporal information within a point cloud sequence is highly important for many down-stream tasks such as 4D semantic segmentation and 3D action recognition. In this paper, we propose a novel framework named Point Spatial-Temporal Transformer (PST2) to learn spatial-temporal representations from dynamic 3D point cloud sequences. Our PST2 consists of two major modules: a Spatio-Temporal Self-Attention (STSA) module and a Resolution Embedding (RE) module. Our STSA module is introduced to capture the spatial-temporal context information across adjacent frames, while the RE module is proposed to aggregate features across neighbors to enhance the resolution of feature maps. We test the effectiveness our PST2 with two different tasks on point cloud sequences, i.e., 4D semantic segmentation and 3D action recognition. Extensive experiments on three benchmarks show that our PST2 outperforms existing methods on all datasets. The effectiveness of our STSA and RE modules have also been justified with ablation experiments.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Action Recognition on MSRAction3D](<https://www.sota2.com/research/sota/action-recognition-on-msraction3d.md>): Action Recognition; MSRAction3D; Accuracy: 89.22.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2110.09783>)

[PDF](<https://arxiv.org/pdf/2110.09783.pdf>)
