# Embedding Semantic Risk into Distance Fields and CBFs for Online Monocular Safe Control

Source: [Embedding Semantic Risk into Distance Fields and CBFs for Online Monocular Safe Control](<https://www.sota2.com/research/paper/6a1e63dcdbd7150506f854bf>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-19T05:00:05.274Z

Authors: Dawei Zhang, Nuo Chen, Shuo Liu, Roberto Tron, Zhiwen Fan

Published: 2026-06-01T02:57:31.000Z

## Abstract

We propose an online monocular perception-to-control framework that embeds semantic risk into the distance field used by Control Barrier Function (CBF)-based safe navigation and teleoperation. Many perception-based safety filters assign the same distance-based safety margin to all mapped obstacles or use semantics only as a downstream controller adjustment, rather than encoding semantic risk in the spatial representation. Our framework instead reasons online about obstacle geometry and class-dependent risk by embedding semantic information directly into the Euclidean Signed Distance Field (ESDF). This design encodes semantic risk before control optimization, so high-risk objects exert a larger spatial influence in the safety field while retaining efficient ESDF queries at runtime. Specifically, a foundation-model-based SLAM front end reconstructs dense 3-D geometry from monocular RGB video, while per-frame semantic segmentation provides pixel-level class labels that are fused into the reconstructed geometry. The resulting geometric-semantic representation is then converted into an ESDF, where semantic labels identify safety-relevant regions and impose class-dependent inflation before field computation. The semantic-aware ESDF provides the local distance values and spatial derivatives required by the CBF controller, while class-dependent gains further regulate the controller response. Extensive simulation and hardware experiments demonstrate online operation at 10--20 Hz and semantic-aware safe behavior in both teleoperation and autonomous navigation.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Safety-aware Navigation on ScanNet++ 486 start-goal trajectories benchmark](<https://www.sota2.com/research/sota/safety-aware-navigation-on-scannet-plus-plus-486-start-goal-trajectories-benchmark.md>): Safety-aware Navigation; ScanNet++ 486 start-goal trajectories benchmark; Progress to Goal: 69.7.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2606.01605>)

[PDF](<https://arxiv.org/pdf/2606.01605.pdf>)
