# Boosting 3D Object Detection by Simulating Multimodality on Point Clouds

Source: [Boosting 3D Object Detection by Simulating Multimodality on Point Clouds](<https://www.sota2.com/research/paper/68fa6cde1e209131cea3661c>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-12-24T17:25:09.893Z

Authors: Wu Zheng, Mingxuan Hong, Li Jiang, Chi-Wing Fu

Published: 2022-06-30T01:44:30.000Z

## Abstract

This paper presents a new approach to boost a single-modality (LiDAR) 3D object detector by teaching it to simulate features and responses that follow a multi-modality (LiDAR-image) detector. The approach needs LiDAR-image data only when training the single-modality detector, and once well-trained, it only needs LiDAR data at inference. We design a novel framework to realize the approach: response distillation to focus on the crucial response samples and avoid the background samples; sparse-voxel distillation to learn voxel semantics and relations from the estimated crucial voxels; a fine-grained voxel-to-point distillation to better attend to features of small and distant objects; and instance distillation to further enhance the deep-feature consistency. Experimental results on the nuScenes dataset show that our approach outperforms all SOTA LiDAR-only 3D detectors and even surpasses the baseline LiDAR-image detector on the key NDS metric, filling 72% mAP gap between the single- and multi-modality detectors.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [3D Object Detection on nuScenes (test)](<https://www.sota2.com/research/sota/3d-object-detection-on-nuscenes-test.md>): 3D Object Detection; nuScenes (test); mAP: 63.6.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2206.14971>)

[PDF](<https://arxiv.org/pdf/2206.14971.pdf>)
