# Pose-based Modular Network for Human-Object Interaction Detection

Source: [Pose-based Modular Network for Human-Object Interaction Detection](<https://www.sota2.com/research/paper/68fa68191e209131cea1a36b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-04T03:16:04.009Z

Authors: Zhijun Liang, Junfa Liu, Yisheng Guan, Juan Rojas

Published: 2020-08-05T10:56:09.000Z

## Abstract

Human-object interaction(HOI) detection is a critical task in scene understanding. The goal is to infer the triplet \<subject, predicate, object\> in a scene. In this work, we note that the human pose itself as well as the relative spatial information of the human pose with respect to the target object can provide informative cues for HOI detection. We contribute a Pose-based Modular Network (PMN) which explores the absolute pose features and relative spatial pose features to improve HOI detection and is fully compatible with existing networks. Our module consists of a branch that first processes the relative spatial pose features of each joint independently. Another branch updates the absolute pose features via fully connected graph structures. The processed pose features are then fed into an action classifier. To evaluate our proposed method, we combine the module with the state-of-the-art model named VS-GATs and obtain significant improvement on two public benchmarks: V-COCO and HICO-DET, which shows its efficacy and flexibility. Code is available at \\url{https://github.com/birlrobotics/PMN}.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Human-Object Interaction Detection on HICO-DET (test)](<https://www.sota2.com/research/sota/human-object-interaction-detection-on-hico-det-test.md>): Human-Object Interaction Detection; HICO-DET (test); mAP (full): 21.21.

- [Human-Object Interaction Detection on V-COCO (test)](<https://www.sota2.com/research/sota/human-object-interaction-detection-on-v-coco-test.md>): Human-Object Interaction Detection; V-COCO (test); AP (Role, Scenario 1): not recorded.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2008.02042>)

[PDF](<https://arxiv.org/pdf/2008.02042.pdf>)

[Implementation](<https://github.com/birlrobotics/PMN>)