# Rectified Diffusion Guidance for Conditional Generation

Source: [Rectified Diffusion Guidance for Conditional Generation](<https://www.sota2.com/research/paper/68fa7bbe1e209131cea8a265>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T05:47:25.110Z

Authors: Mengfei Xia, Nan Xue, Yujun Shen, Ran Yi, Tieliang Gong, Yong-Jin Liu

Published: 2024-10-24T13:41:32.000Z

## Abstract

Classifier-Free Guidance (CFG), which combines the conditional and unconditional score functions with two coefficients summing to one, serves as a practical technique for diffusion model sampling. Theoretically, however, denoising with CFG \\textit{cannot} be expressed as a reciprocal diffusion process, which may consequently leave some hidden risks during use. In this work, we revisit the theory behind CFG and rigorously confirm that the improper configuration of the combination coefficients (\\textit{i.e.}, the widely used summing-to-one version) brings about expectation shift of the generative distribution. To rectify this issue, we propose ReCFG with a relaxation on the guidance coefficients such that denoising with \\method strictly aligns with the diffusion theory. We further show that our approach enjoys a \\textbf{\\textit{closed-form}} solution given the guidance strength. That way, the rectified coefficients can be readily pre-computed via traversing the observed data, leaving the sampling speed barely affected. Empirical evidence on real-world data demonstrate the compatibility of our post-hoc design with existing state-of-the-art diffusion models, including both class-conditioned ones (\\textit{e.g.}, EDM2 on ImageNet) and text-conditioned ones (\\textit{e.g.}, SD3 on CC12M), without any retraining. Code is available at \\href{https://github.com/thuxmf/recfg}{https://github.com/thuxmf/recfg}.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2410.18737>)

[PDF](<https://arxiv.org/pdf/2410.18737.pdf>)
