# Self-Improving Semantic Perception for Indoor Localisation

Source: [Self-Improving Semantic Perception for Indoor Localisation](<https://www.sota2.com/research/paper/68fa6b4d1e209131cea2d6d1>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:45:08.233Z

Authors: Hermann Blum, Francesco Milano, Ren\\'e Zurbr\\"ugg, Roland Siegward, Cesar Cadena, Abel Gawel

Published: 2021-05-04T16:06:12.000Z

## Abstract

We propose a novel robotic system that can improve its perception during deployment. Contrary to the established approach of learning semantics from large datasets and deploying fixed models, we propose a framework in which semantic models are continuously updated on the robot to adapt to the deployment environments. By combining continual learning with self-supervision, our robotic system learns online during deployment without external supervision. We conduct real-world experiments with robots localising in 3D floorplans. Our experiments show how the robot's semantic perception improves during deployment and how this translates into improved localisation, even across drastically different environments. We further study the risk of catastrophic forgetting that such a continuous learning setting poses. We find memory replay an effective measure to reduce forgetting and show how the robotic system can improve even when switching between different environments. On average, our system improves by 60% in segmentation and 10% in localisation accuracy compared to deployment of a fixed model, and it maintains this improvement while adapting to further environments.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2105.01595>)

[PDF](<https://arxiv.org/pdf/2105.01595.pdf>)
