# Edge Prediction for Roof Wireframe Reconstruction with Transformers

Source: [Edge Prediction for Roof Wireframe Reconstruction with Transformers](<https://www.sota2.com/research/paper/6a1e6425dbd7150506f857f4>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T05:03:19.764Z

Authors: Gustav Hanning, Ludvig Dill\\'en, Jonathan Astermark, Johanna Lidholm, Viktor Larsson

Published: 2026-06-01T15:51:30.000Z

## Abstract

This paper presents a competitive solution to the S23DR Challenge 2026, which aims to reconstruct 3D house roof wireframe models from sparse SfM point clouds and ground-level semantic segmentations and depth maps. Our proposed method utilizes an end-to-end Transformer encoder-decoder architecture inspired by DETR. To effectively process the geometric and semantic data, the sparse SfM point cloud input is dynamically subsampled based on semantic priority and augmented with Gestalt and ADE20k class features. To further increase segmentation context, we fuse the point features with additional Gestalt feature encodings which are obtained by projecting the points into latent feature maps produced by a frozen autoencoder. Learned query embeddings are then decoded directly into 3D wireframe edges via cross-attention mechanisms. Evaluated on the "HoHo 22k" dataset, our approach significantly outperforms both handcrafted and learned baselines, achieving a Hybrid Structure Score (HSS) of 0.6476 and securing the second-highest position on the challenge's private leaderboard.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [3D roof wireframe reconstruction on HoHo 22k (public test)](<https://www.sota2.com/research/sota/3d-roof-wireframe-reconstruction-on-hoho-22k-public-test.md>): 3D roof wireframe reconstruction; HoHo 22k (public test); HSS: 60.67.

- [3D roof wireframe reconstruction on HoHo 22k (private test)](<https://www.sota2.com/research/sota/3d-roof-wireframe-reconstruction-on-hoho-22k-private-test.md>): 3D roof wireframe reconstruction; HoHo 22k (private test); HSS: 64.76.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2606.02406>)

[PDF](<https://arxiv.org/pdf/2606.02406.pdf>)