# Generative Modeling Perspective for Control and Reasoning in Robotics

Source: [Generative Modeling Perspective for Control and Reasoning in Robotics](<https://www.sota2.com/research/paper/68fa74a21e209131cea62d11>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:39:01.541Z

Authors: Takuma Yoneda

Published: 2024-08-30T06:42:10.000Z

## Abstract

Heralded by the initial success in speech recognition and image classification, learning-based approaches with neural networks, commonly referred to as deep learning, have spread across various fields. A primitive form of a neural network functions as a deterministic mapping from one vector to another, parameterized by trainable weights. This is well suited for point estimation in which the model learns a one-to-one mapping (e.g., mapping a front camera view to a steering angle) that is required to solve the task of interest. Although learning such a deterministic, one-to-one mapping is effective, there are scenarios where modeling \\emph{multimodal} data distributions, namely learning one-to-many relationships, is helpful or even necessary.   In this thesis, we adopt a generative modeling perspective on robotics problems. Generative models learn and produce samples from multimodal distributions, rather than performing point estimation. We will explore the advantages this perspective offers for three topics in robotics.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2408.17041>)

[PDF](<https://arxiv.org/pdf/2408.17041.pdf>)
