# Predicting Human Perceptions of Robot Performance During Navigation Tasks

Source: [Predicting Human Perceptions of Robot Performance During Navigation Tasks](<https://www.sota2.com/research/paper/68fa758e1e209131cea689b9>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-12-04T05:01:31.288Z

Authors: Qiping Zhang, Nathan Tsoi, Mofeed Nagib, Booyeon Choi, Jie Tan, Hao-Tien Lewis Chiang, Marynel V\\'azquez

Published: 2023-10-17T21:12:32.000Z

## Abstract

Understanding human perceptions of robot performance is crucial for designing socially intelligent robots that can adapt to human expectations. Current approaches often rely on surveys, which can disrupt ongoing human-robot interactions. As an alternative, we explore predicting people's perceptions of robot performance using non-verbal behavioral cues and machine learning techniques. We contribute the SEAN TOGETHER Dataset consisting of observations of an interaction between a person and a mobile robot in Virtual Reality, together with perceptions of robot performance provided by users on a 5-point scale. We then analyze how well humans and supervised learning techniques can predict perceived robot performance based on different observation types (like facial expression and spatial behavior features). Our results suggest that facial expressions alone provide useful information, but in the navigation scenarios that we considered, reasoning about spatial features in context is critical for the prediction task. Also, supervised learning techniques outperformed humans' predictions in most cases. Further, when predicting robot performance as a binary classification task on unseen users' data, the F1-Score of machine learning models more than doubled that of predictions on a 5-point scale. This suggested good generalization capabilities, particularly in identifying performance directionality over exact ratings. Based on these findings, we conducted a real-world demonstration where a mobile robot uses a machine learning model to predict how a human who follows it perceives it. Finally, we discuss the implications of our results for implementing these supervised learning models in real-world navigation. Our work paves the path to automatically enhancing robot behavior based on observations of users and inferences about their perceptions of a robot.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Robot Competence Prediction on SEAN Together (LOOCV)](<https://www.sota2.com/research/sota/robot-competence-prediction-on-sean-together-loocv.md>): Robot Competence Prediction; SEAN Together (LOOCV); F1 Score: 73.

- [Robot Intention Prediction on SEAN Together (LOOCV)](<https://www.sota2.com/research/sota/robot-intention-prediction-on-sean-together-loocv.md>): Robot Intention Prediction; SEAN Together (LOOCV); F1 Score: 70.7.

- [Social Navigation Perception Prediction on SEAN TOGETHER v2](<https://www.sota2.com/research/sota/social-navigation-perception-prediction-on-sean-together-v2.md>): Social Navigation Perception Prediction; SEAN TOGETHER v2; Competence: 66.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2310.11590>)

[PDF](<https://arxiv.org/pdf/2310.11590.pdf>)
