# CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement

Source: [CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement](<https://www.sota2.com/research/paper/68fa765f1e209131cea6cb84>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-02T08:32:45.741Z

Authors: Yun Liu, Chengwen Zhang, Ruofan Xing, Bingda Tang, Bowen Yang, Li Yi

Published: 2024-06-27T17:32:18.000Z

## Abstract

Understanding how humans cooperatively rearrange household objects is critical for VR/AR and human-robot interaction. However, in-depth studies on modeling these behaviors are under-researched due to the lack of relevant datasets. We fill this gap by presenting CORE4D, a novel large-scale 4D human-object-human interaction dataset focusing on collaborative object rearrangement, which encompasses diverse compositions of various object geometries, collaboration modes, and 3D scenes. With 1K human-object-human motion sequences captured in the real world, we enrich CORE4D by contributing an iterative collaboration retargeting strategy to augment motions to a variety of novel objects. Leveraging this approach, CORE4D comprises a total of 11K collaboration sequences spanning 3K real and virtual object shapes. Benefiting from extensive motion patterns provided by CORE4D, we benchmark two tasks aiming at generating human-object interaction: human-object motion forecasting and interaction synthesis. Extensive experiments demonstrate the effectiveness of our collaboration retargeting strategy and indicate that CORE4D has posed new challenges to existing human-object interaction generation methodologies.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Hand-object interaction quality on CORE4D](<https://www.sota2.com/research/sota/hand-object-interaction-quality-on-core4d.md>): Hand-object interaction quality; CORE4D; Contact Coverage: 6.72.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2406.19353>)

[PDF](<https://arxiv.org/pdf/2406.19353.pdf>)

[Implementation](<https://core4d.github.io/>)
