# DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder Source: [DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder]() Collection index: [llms.txt]() Data updated: 2025-10-26T00:17:38.470Z Authors: Jie Shi, Chenfei Wu, Jian Liang, Xiang Liu, Nan Duan Published: 2022-06-01T10:39:12.000Z ## Abstract Recently most successful image synthesis models are multi stage process to combine the advantages of different methods, which always includes a VAE-like model for faithfully reconstructing embedding to image and a prior model to generate image embedding. At the same time, diffusion models have shown be capacity to generate high-quality synthetic images. Our work proposes a VQ-VAE architecture model with a diffusion decoder (DiVAE) to work as the reconstructing component in image synthesis. We explore how to input image embedding into diffusion model for excellent performance and find that simple modification on diffusion's UNet can achieve it. Training on ImageNet, Our model achieves state-of-the-art results and generates more photorealistic images specifically. In addition, we apply the DiVAE with an Auto-regressive generator on conditional synthesis tasks to perform more human-feeling and detailed samples. ## Recorded benchmark results A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. - [Image Reconstruction on ImageNet1K (val)](): Image Reconstruction; ImageNet1K (val); FID: 4.07. ## Original sources and implementation [Original paper]() [PDF]()