# Translating Universal Scene Descriptions into Knowledge Graphs for Robotic Environment

Source: [Translating Universal Scene Descriptions into Knowledge Graphs for Robotic Environment](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed23>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T01:56:42.060Z

Authors: Giang Hoang Nguyen, Daniel Bessler, Simon Stelter, Mihai Pomarlan, Michael Beetz

Published: 2023-10-25T16:09:40.000Z

## Abstract

Robots performing human-scale manipulation tasks require an extensive amount of knowledge about their surroundings in order to perform their actions competently and human-like. In this work, we investigate the use of virtual reality technology as an implementation for robot environment modeling, and present a technique for translating scene graphs into knowledge bases. To this end, we take advantage of the Universal Scene Description (USD) format which is an emerging standard for the authoring, visualization and simulation of complex environments. We investigate the conversion of USD-based environment models into Knowledge Graph (KG) representations that facilitate semantic querying and integration with additional knowledge sources.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Ontology Grounding on Pixar Kitchen Set semantic regime SOMA-HOME ontology (test)](<https://www.sota2.com/research/sota/ontology-grounding-on-pixar-kitchen-set-semantic-regime-soma-home-ontology-test.md>): Ontology Grounding; Pixar Kitchen Set semantic regime SOMA-HOME ontology (test); EMA: 9.

- [Ontology Grounding on Pixar Kitchen Set opaque regime SOMA-HOME ontology (test)](<https://www.sota2.com/research/sota/ontology-grounding-on-pixar-kitchen-set-opaque-regime-soma-home-ontology-test.md>): Ontology Grounding; Pixar Kitchen Set opaque regime SOMA-HOME ontology (test); EMA: 0.

- [Ontology Grounding on Pixar Kitchen Set abbreviated regime SOMA-HOME ontology (test)](<https://www.sota2.com/research/sota/ontology-grounding-on-pixar-kitchen-set-abbreviated-regime-soma-home-ontology-test.md>): Ontology Grounding; Pixar Kitchen Set abbreviated regime SOMA-HOME ontology (test); EMA: 0.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2310.16737>)

[PDF](<https://arxiv.org/pdf/2310.16737.pdf>)
