# Learned Fusion: 3D Object Detection using Calibration-Free Transformer Feature Fusion

Source: [Learned Fusion: 3D Object Detection using Calibration-Free Transformer Feature Fusion](<https://www.sota2.com/research/paper/68fa71731e209131cea514fa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:06:39.354Z

Authors: Michael F\\"urst, Rahul Jakkamsetty, Ren\\'e Schuster, Didier Stricker

Published: 2023-12-14T16:15:31.000Z

## Abstract

The state of the art in 3D object detection using sensor fusion heavily relies on calibration quality, which is difficult to maintain in large scale deployment outside a lab environment. We present the first calibration-free approach for 3D object detection. Thus, eliminating the need for complex and costly calibration procedures. Our approach uses transformers to map the features between multiple views of different sensors at multiple abstraction levels. In an extensive evaluation for object detection, we not only show that our approach outperforms single modal setups by 14.1% in BEV mAP, but also that the transformer indeed learns mapping. By showing calibration is not necessary for sensor fusion, we hope to motivate other researchers following the direction of calibration-free fusion. Additionally, resulting approaches have a substantial resilience against rotation and translation changes.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2312.09082>)

[PDF](<https://arxiv.org/pdf/2312.09082.pdf>)
