# RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learning

Source: [RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learning](<https://www.sota2.com/research/paper/68fa71551e209131cea50922>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-28T13:57:02.765Z

Authors: Kevin Zakka, Philipp Wu, Laura Smith, Nimrod Gileadi, Taylor Howell, Xue Bin Peng, Sumeet Singh, Yuval Tassa, Pete Florence, Andy Zeng, Pieter Abbeel

Published: 2023-04-09T03:53:05.000Z

## Abstract

Replicating human-like dexterity in robot hands represents one of the largest open problems in robotics. Reinforcement learning is a promising approach that has achieved impressive progress in the last few years; however, the class of problems it has typically addressed corresponds to a rather narrow definition of dexterity as compared to human capabilities. To address this gap, we investigate piano-playing, a skill that challenges even the human limits of dexterity, as a means to test high-dimensional control, and which requires high spatial and temporal precision, and complex finger coordination and planning. We introduce RoboPianist, a system that enables simulated anthropomorphic hands to learn an extensive repertoire of 150 piano pieces where traditional model-based optimization struggles. We additionally introduce an open-sourced environment, benchmark of tasks, interpretable evaluation metrics, and open challenges for future study. Our website featuring videos, code, and datasets is available at https://kzakka.com/robopianist/

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Piano Key Contact Prediction on FürElise Dataset (test)](<https://www.sota2.com/research/sota/piano-key-contact-prediction-on-f-relise-dataset-test.md>): Piano Key Contact Prediction; FürElise Dataset (test); Precision: 99.6.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2304.04150>)

[PDF](<https://arxiv.org/pdf/2304.04150.pdf>)
