# Baking in the Feature: Accelerating Volumetric Segmentation by Rendering Feature Maps

Source: [Baking in the Feature: Accelerating Volumetric Segmentation by Rendering Feature Maps](<https://www.sota2.com/research/paper/68fa6d881e209131cea3a710>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T00:36:22.217Z

Authors: Kenneth Blomqvist, Lionel Ott, Jen Jen Chung, Roland Siegwart

Published: 2022-09-26T14:52:10.000Z

## Abstract

Methods have recently been proposed that densely segment 3D volumes into classes using only color images and expert supervision in the form of sparse semantically annotated pixels. While impressive, these methods still require a relatively large amount of supervision and segmenting an object can take several minutes in practice. Such systems typically only optimize their representation on the particular scene they are fitting, without leveraging any prior information from previously seen images. In this paper, we propose to use features extracted with models trained on large existing datasets to improve segmentation performance. We bake this feature representation into a Neural Radiance Field (NeRF) by volumetrically rendering feature maps and supervising on features extracted from each input image. We show that by baking this representation into the NeRF, we make the subsequent classification task much easier. Our experiments show that our method achieves higher segmentation accuracy with fewer semantic annotations than existing methods over a wide range of scenes.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2209.12744>)

[PDF](<https://arxiv.org/pdf/2209.12744.pdf>)
