# PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarios

Source: [PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarios](<https://www.sota2.com/research/paper/68fa730a1e209131cea5a07b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-04T04:51:07.211Z

Authors: Jingbo Wang, Zhengyi Luo, Ye Yuan, Yixuan Li, Bo Dai

Published: 2024-04-30T17:15:42.000Z

## Abstract

We address the challenge of content diversity and controllability in pedestrian simulation for driving scenarios. Recent pedestrian animation frameworks have a significant limitation wherein they primarily focus on either following trajectory \[46\] or the content of the reference video \[57\], consequently overlooking the potential diversity of human motion within such scenarios. This limitation restricts the ability to generate pedestrian behaviors that exhibit a wider range of variations and realistic motions and therefore restricts its usage to provide rich motion content for other components in the driving simulation system, e.g., suddenly changed motion to which the autonomous vehicle should respond. In our approach, we strive to surpass the limitation by showcasing diverse human motions obtained from various sources, such as generated human motions, in addition to following the given trajectory. The fundamental contribution of our framework lies in combining the motion tracking task with trajectory following, which enables the tracking of specific motion parts (e.g., upper body) while simultaneously following the given trajectory by a single policy. This way, we significantly enhance both the diversity of simulated human motion within the given scenario and the controllability of the content, including language-based control. Our framework facilitates the generation of a wide range of human motions, contributing to greater realism and adaptability in pedestrian simulations for driving scenarios. More information is on our project page https://wangjingbo1219.github.io/papers/CVPR2024\_PACER\_PLUS/PACERPLUSPage.html .

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Pedestrian Animation Synthesis on Synthetic Terrain Trajectories Normal Speed 1.0 (test)](<https://www.sota2.com/research/sota/pedestrian-animation-synthesis-on-synthetic-terrain-trajectories-normal-speed-1-0-test.md>): Pedestrian Animation Synthesis; Synthetic Terrain Trajectories Normal Speed 1.0 (test); FID: 6.74.

- [Pedestrian Animation Synthesis on Synthetic Terrain Trajectories Low Speed \< 1m/s 1.0 (test)](<https://www.sota2.com/research/sota/pedestrian-animation-synthesis-on-synthetic-terrain-trajectories-low-speed-1m-s-1-0-test.md>): Pedestrian Animation Synthesis; Synthetic Terrain Trajectories Low Speed \< 1m/s 1.0 (test); l-FID: 7.62.

- [Trajectory following on Synthetic terrain and trajectories](<https://www.sota2.com/research/sota/trajectory-following-on-synthetic-terrain-and-trajectories.md>): Trajectory following; Synthetic terrain and trajectories; Error: 0.123.

- [Motion Tracking on NIKI real-world](<https://www.sota2.com/research/sota/motion-tracking-on-niki-real-world.md>): Motion Tracking; NIKI real-world; FS: 7.68.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2404.19722>)

[PDF](<https://arxiv.org/pdf/2404.19722.pdf>)