# Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometry

Source: [Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometry](<https://www.sota2.com/research/paper/68fa6ec41e209131cea41e3c>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T01:05:49.615Z

Authors: Jiaxu Zhang, Junwu Weng, Di Kang, Fang Zhao, Shaoli Huang, Xuefei Zhe, Linchao Bao, Ying Shan, Jue Wang, Zhigang Tu

Published: 2023-03-15T14:41:26.000Z

## Abstract

A good motion retargeting cannot be reached without reasonable consideration of source-target differences on both the skeleton and shape geometry levels. In this work, we propose a novel Residual RETargeting network (R2ET) structure, which relies on two neural modification modules, to adjust the source motions to fit the target skeletons and shapes progressively. In particular, a skeleton-aware module is introduced to preserve the source motion semantics. A shape-aware module is designed to perceive the geometries of target characters to reduce interpenetration and contact-missing. Driven by our explored distance-based losses that explicitly model the motion semantics and geometry, these two modules can learn residual motion modifications on the source motion to generate plausible retargeted motion in a single inference without post-processing. To balance these two modifications, we further present a balancing gate to conduct linear interpolation between them. Extensive experiments on the public dataset Mixamo demonstrate that our R2ET achieves the state-of-the-art performance, and provides a good balance between the preservation of motion semantics as well as the attenuation of interpenetration and contact-missing. Code is available at https://github.com/Kebii/R2ET.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Intra-Structural Motion Retargeting on Mixamo](<https://www.sota2.com/research/sota/intra-structural-motion-retargeting-on-mixamo.md>): Intra-Structural Motion Retargeting; Mixamo; MSE (sc+sm): 0.00424.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2303.08658>)

[PDF](<https://arxiv.org/pdf/2303.08658.pdf>)
