# DOMR: Establishing Cross-View Segmentation via Dense Object Matching

Source: [DOMR: Establishing Cross-View Segmentation via Dense Object Matching](<https://www.sota2.com/research/paper/68fa7a711e209131cea8341d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-28T13:57:20.117Z

Authors: Jitong Liao, Yulu Gao, Shaofei Huang, Jialin Gao, Jie Lei, Ronghua Liang, Si Liu

Published: 2025-08-06T03:23:37.000Z

## Abstract

Cross-view object correspondence involves matching objects between egocentric (first-person) and exocentric (third-person) views. It is a critical yet challenging task for visual understanding. In this work, we propose the Dense Object Matching and Refinement (DOMR) framework to establish dense object correspondences across views. The framework centers around the Dense Object Matcher (DOM) module, which jointly models multiple objects. Unlike methods that directly match individual object masks to image features, DOM leverages both positional and semantic relationships among objects to find correspondences. DOM integrates a proposal generation module with a dense matching module that jointly encodes visual, spatial, and semantic cues, explicitly constructing inter-object relationships to achieve dense matching among objects. Furthermore, we combine DOM with a mask refinement head designed to improve the completeness and accuracy of the predicted masks, forming the complete DOMR framework. Extensive evaluations on the Ego-Exo4D benchmark demonstrate that our approach achieves state-of-the-art performance with a mean IoU of 49.7% on Ego$\\to$Exo and 55.2% on Exo$\\to$Ego. These results outperform those of previous methods by 5.8% and 4.3%, respectively, validating the effectiveness of our integrated approach for cross-view understanding.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Cross-view Instance Segmentation on MvMHAT](<https://www.sota2.com/research/sota/cross-view-instance-segmentation-on-mvmhat.md>): Cross-view Instance Segmentation; MvMHAT; AP: 71.1.

- [Cross-view Instance Segmentation on Ego-Exo4D Ego-to-Exo](<https://www.sota2.com/research/sota/cross-view-instance-segmentation-on-ego-exo4d-ego-to-exo.md>): Cross-view Instance Segmentation; Ego-Exo4D Ego-to-Exo; IoU: 49.7.

- [Cross-view Instance Segmentation on Ego-Exo4D Exo-to-Ego](<https://www.sota2.com/research/sota/cross-view-instance-segmentation-on-ego-exo4d-exo-to-ego.md>): Cross-view Instance Segmentation; Ego-Exo4D Exo-to-Ego; IoU: 55.2.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2508.04050>)

[PDF](<https://arxiv.org/pdf/2508.04050.pdf>)
