# Interact as You Intend: Intention-Driven Human-Object Interaction Detection

Source: [Interact as You Intend: Intention-Driven Human-Object Interaction Detection](<https://www.sota2.com/research/paper/68fa665e1e209131cea0fdec>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:48:29.028Z

Authors: Bingjie Xu, Junnan Li, Yongkang Wong, Mohan S. Kankanhalli, Qi Zhao

Published: 2018-08-29T13:25:50.000Z

## Abstract

The recent advances in instance-level detection tasks lay strong foundation for genuine comprehension of the visual scenes. However, the ability to fully comprehend a social scene is still in its preliminary stage. In this work, we focus on detecting human-object interactions (HOIs) in social scene images, which is demanding in terms of research and increasingly useful for practical applications. To undertake social tasks interacting with objects, humans direct their attention and move their body based on their intention. Based on this observation, we provide a unique computational perspective to explore human intention in HOI detection. Specifically, the proposed human intention-driven HOI detection (iHOI) framework models human pose with the relative distances from body joints to the object instances. It also utilizes human gaze to guide the attended contextual regions in a weakly-supervised setting. In addition, we propose a hard negative sampling strategy to address the problem of mis-grouping. We perform extensive experiments on two benchmark datasets, namely V-COCO and HICO-DET. The efficacy of each proposed component has also been validated.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Human-Object Interaction Detection on V-COCO (test)](<https://www.sota2.com/research/sota/human-object-interaction-detection-on-v-coco-test.md>): Human-Object Interaction Detection; V-COCO (test); AP (Role, Scenario 1): not recorded.

- [Human-Object Interaction Detection on HICO-DET](<https://www.sota2.com/research/sota/human-object-interaction-detection-on-hico-det.md>): Human-Object Interaction Detection; HICO-DET; mAP (Full): not recorded.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1808.09796>)

[PDF](<https://arxiv.org/pdf/1808.09796.pdf>)