# MatE: Material Extraction from Single-Image via Geometric Prior

Source: [MatE: Material Extraction from Single-Image via Geometric Prior](<https://www.sota2.com/research/paper/694a21e99eebe296e72aa519>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-12-24T05:00:04.857Z

Authors: Zeyu Zhang, Wei Zhai, Jian Yang, Yang Cao

Published: 2025-12-20T10:53:49.000Z

## Abstract

The creation of high-fidelity, physically-based rendering (PBR) materials remains a bottleneck in many graphics pipelines, typically requiring specialized equipment and expert-driven post-processing. To democratize this process, we present MatE, a novel method for generating tileable PBR materials from a single image taken under unconstrained, real-world conditions. Given an image and a user-provided mask, MatE first performs coarse rectification using an estimated depth map as a geometric prior, and then employs a dual-branch diffusion model. Leveraging a learned consistency from rotation-aligned and scale-aligned training data, this model further rectify residual distortions from the coarse result and translate it into a complete set of material maps, including albedo, normal, roughness and height. Our framework achieves invariance to the unknown illumination and perspective of the input image, allowing for the recovery of intrinsic material properties from casual captures. Through comprehensive experiments on both synthetic and real-world data, we demonstrate the efficacy and robustness of our approach, enabling users to create realistic materials from real-world image.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Material Extraction on Polyhaven Real-World (test)](<https://www.sota2.com/research/sota/material-extraction-on-polyhaven-real-world-test.md>): Material Extraction; Polyhaven Real-World (test); LPIPS: 0.342.

- [Material Extraction on Polyhaven Synthetic (test)](<https://www.sota2.com/research/sota/material-extraction-on-polyhaven-synthetic-test.md>): Material Extraction; Polyhaven Synthetic (test); LPIPS: 0.345.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2512.18312>)

[PDF](<https://arxiv.org/pdf/2512.18312.pdf>)
