# A hierarchical spatial-aware algorithm with efficient reinforcement learning for human-robot task planning and allocation in production

Source: [A hierarchical spatial-aware algorithm with efficient reinforcement learning for human-robot task planning and allocation in production](<https://www.sota2.com/research/paper/69df1bba7d0172140ec7babe>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-18T05:00:04.772Z

Authors: Jintao Xue, Xiao Li, Nianmin Zhang

Published: 2026-04-14T12:40:05.000Z

## Abstract

In advanced manufacturing systems, humans and robots collaborate to conduct the production process. Effective task planning and allocation (TPA) is crucial for achieving high production efficiency, yet it remains challenging in complex and dynamic manufacturing environments. The dynamic nature of humans and robots, particularly the need to consider spatial information (e.g., humans' real-time position and the distance they need to move to complete a task), substantially complicates TPA. To address the above challenges, we decompose production tasks into manageable subtasks. We then implement a real-time hierarchical human-robot TPA algorithm, including a high-level agent for task planning and a low-level agent for task allocation. For the high-level agent, we propose an efficient buffer-based deep Q-learning method (EBQ), which reduces training time and enhances performance in production problems with long-term and sparse reward challenges. For the low-level agent, a path planning-based spatially aware method (SAP) is designed to allocate tasks to the appropriate human-robot resources, thereby achieving the corresponding sequential subtasks. We conducted experiments on a complex real-time production process in a 3D simulator. The results demonstrate that our proposed EBQ&SAP method effectively addresses human-robot TPA problems in complex and dynamic production processes.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Task Planning and Allocation on Human-Robot Task Planning and Allocation (TPA) (test)](<https://www.sota2.com/research/sota/task-planning-and-allocation-on-human-robot-task-planning-and-allocation-tpa-test.md>): Task Planning and Allocation; Human-Robot Task Planning and Allocation (TPA) (test); H1,R1 Time/Cost: 934.35.

- [Human-robot task planning and allocation on Production Task Num1 (unseen product quantities)](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-num1-unseen-product-quantities.md>): human-robot task planning and allocation; Production Task Num1 (unseen product quantities); Makespan: 312.91.

- [Human-robot task planning and allocation on Production Task Num5 (unseen product quantities)](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-num5-unseen-product-quantities.md>): human-robot task planning and allocation; Production Task Num5 (unseen product quantities); Makespan: 810.13.

- [Human-robot task planning and allocation on Production Task unseen product quantities Num6](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-unseen-product-quantities-num6.md>): human-robot task planning and allocation; Production Task unseen product quantities Num6; Makespan: 984.82.

- [Human-robot task planning and allocation on Production Task Num7 (unseen product quantities)](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-num7-unseen-product-quantities.md>): human-robot task planning and allocation; Production Task Num7 (unseen product quantities); Makespan: 1147.13.

- [Human-robot task planning and allocation on Production Task Mean (unseen product quantities)](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-mean-unseen-product-quantities.md>): human-robot task planning and allocation; Production Task Mean (unseen product quantities); Makespan: 947.7.

- [Human-robot task planning and allocation on Production Task unseen product quantities Num2](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-unseen-product-quantities-num2.md>): human-robot task planning and allocation; Production Task unseen product quantities Num2; Makespan: 442.59.

- [Human-robot task planning and allocation on Production Task Num3 (unseen product quantities)](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-num3-unseen-product-quantities.md>): human-robot task planning and allocation; Production Task Num3 (unseen product quantities); Makespan: 561.81.

- [Human-robot task planning and allocation on Production Task Num8 (unseen product quantities)](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-num8-unseen-product-quantities.md>): human-robot task planning and allocation; Production Task Num8 (unseen product quantities); Makespan: 1320.18.

- [Human-robot task planning and allocation on Production Task Num4 (unseen product quantities)](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-num4-unseen-product-quantities.md>): human-robot task planning and allocation; Production Task Num4 (unseen product quantities); Makespan: 733.99.

- [Human-robot task planning and allocation on Production Task unseen product quantities Num9](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-unseen-product-quantities-num9.md>): human-robot task planning and allocation; Production Task unseen product quantities Num9; Makespan: 1499.92.

- [Human-robot task planning and allocation on Production Task unseen product quantities Num10](<https://www.sota2.com/research/sota/human-robot-task-planning-and-allocation-on-production-task-unseen-product-quantities-num10.md>): human-robot task planning and allocation; Production Task unseen product quantities Num10; Makespan: 1612.56.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2604.12669>)

[PDF](<https://arxiv.org/pdf/2604.12669.pdf>)
