Text-to-Image Generation on Pick-a-Pic
69.67PickScoreBalancedDPO
Evaluation results
| Method | Links | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BalancedDPOComparison=vs DiffusionDPO, Backbone=Stable Diffusion 2.12025.03 | 69.67 | 65.67 | 53.67 | — | 70 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BalancedDPOComparison=vs SD 2.1, Backbone=Stable Diffusion 2.12025.03 | 69.33 | 65.33 | 62.33 | — | 65.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BalancedDPO vs DiffusionDPOcomparison=BalancedDPO vs DiffusionDPO2025.03 | 65.99 | 73.4 | 73.06 | — | 69.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BalancedDPO vs SD1.5comparison=BalancedDPO vs SD1.52025.03 | 64.31 | 78.45 | 85.19 | — | 69.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BalancedDPOComparison Baseline=DiffusionDPO2025.03 | 64 | 77 | 82 | — | 81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BalancedDPOComparison Baseline=SDXL2025.03 | 62 | 88 | 98 | — | 44 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DiffusionDPO vs SD1.5comparison=DiffusionDPO vs SD1.52025.03 | 56.23 | 57.24 | 70.71 | — | 52.86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DiffusionDPOComparison=vs SD 2.1, Backbone=Stable Diffusion 2.12025.03 | 50.67 | 47.67 | 57.33 | — | 45.67 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DiffusionDPOComparison Baseline=SDXL2025.03 | 45 | 59 | 78 | — | 21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Particle SamplingModel=FLUX2025.11 | 23.31 | — | 31.56 | 1.45 | 6.532 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LoTTSModel=FLUX2025.11 | 23.04 | — | 33.33 | 1.605 | 6.501 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Best-of-NModel=FLUX2025.11 | 22.89 | — | 30.23 | 1.235 | 6.299 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Diff.-NPOBase Model=SDXL2026.05 | 22.78 | 37.01 | 28.85 | 1.2599 | 6.4294 | — | — | — | — | — | — | — | — | 82.64 | 86.12 | 55.12 | 89.56 | 74.96 | 77.68 | — | — | |
| NoiseARModel=DreamShaper2026.03 | 22.71 | — | — | 1.1112 | — | — | 33.64 | 10.44 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Online-DPOBase Model=SDXL2026.05 | 22.71 | 37.05 | 28.57 | 1.1247 | 6.2686 | — | — | — | — | — | — | — | — | 82.08 | 81.92 | 56.16 | 85.32 | 65.64 | 74.22 | — | — | |
| Golden NoiseModel=DreamShaper2026.03 | 22.69 | — | — | 1.0391 | — | — | 32.69 | 10.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NDVersion=3.5-L2026.05 | 22.6885 | 0.2864 | 0.3231 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.2215 | 550 | |
| Naïve PAINEModel=DreamShaper2026.03 | 22.64 | — | — | 1.066 | — | — | 33.27 | 10.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Naïve PAINEModel=DreamShaper2026.03 | 22.64 | — | — | 1.066 | — | — | 33.27 | 10.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=DreamShaper2026.03 | 22.6 | — | — | 0.9806 | — | — | 32.51 | 10.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=DreamShaper2026.03 | 22.6 | — | — | 0.9806 | — | — | 32.51 | 10.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NSVersion=3.5-L2026.05 | 22.5564 | 0.2833 | 0.3221 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.2142 | 333 | |
| ABSSVersion=3.5-L2026.05 | 22.537 | 0.2834 | 0.3258 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.2362 | 71 | |
| GOLDENVersion=3.5-L2026.05 | 22.5221 | 0.2814 | 0.3249 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.2153 | 209 | |
| RANDOMVersion=3.5-L2026.05 | 22.5108 | 0.2836 | 0.3208 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.2031 | 50 | |
| CFG-MP+Model=SD3.5, Guidance Scale (ω)=3.0, NFE=1002026.01 | 22.51 | 32.75 | 30.83 | 1.13 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MP+Model=SD3.5, Guidance Scale (ω)=3.0, NFE=602026.01 | 22.47 | 32.68 | 30.78 | 1.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MPModel=SD3.5, Guidance Scale (ω)=3.0, NFE=1002026.01 | 22.4 | 32.64 | 30.15 | 1.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MPModel=SD3.5, Guidance Scale (ω)=3.0, NFE=602026.01 | 22.37 | 32.6 | 29.77 | 1.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| R-CFG++Model=SD3.5, Guidance Scale (ω)=3.0, NFE=1002026.01 | 22.37 | 32.6 | 29.78 | 1.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-0*Model=SD3.5, Guidance Scale (ω)=3.0, NFE=1002026.01 | 22.36 | 32.61 | 29.81 | 1.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MPModel=Flux-dev, Guidance Scale (ω)=3, NFE=1202026.01 | 22.35 | 32.57 | 31.01 | 1.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| R-CFG++Model=SD3.5, Guidance Scale (ω)=3.0, NFE=602026.01 | 22.35 | 32.6 | 29.89 | 1.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MP+Model=Flux-dev, Guidance Scale (ω)=3, NFE=1202026.01 | 22.34 | 32.55 | 31.21 | 1.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-0*Model=SD3.5, Guidance Scale (ω)=3.0, NFE=602026.01 | 22.34 | 32.57 | 29.76 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFGModel=SD3.5, Guidance Scale (ω)=3.0, NFE=1002026.01 | 22.34 | 32.57 | 29.73 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CORE^2Version=3.5-L2026.05 | 22.3304 | 0.2841 | 0.3196 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.1572 | 50 | |
| R-CFG++Model=SD3.5, Guidance Scale (ω)=4.0, NFE=1002026.01 | 22.33 | 32.53 | 30.25 | 1.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFGModel=SD3.5, Guidance Scale (ω)=3.0, NFE=602026.01 | 22.32 | 32.55 | 29.69 | 0.99 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| R-CFG++Model=SD3.5, Guidance Scale (ω)=4.0, NFE=602026.01 | 22.32 | 32.52 | 30.45 | 1.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MP+Model=SD3.5, Guidance Scale (ω)=4.0, NFE=1002026.01 | 22.32 | 32.56 | 31.15 | 1.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-0*Model=SD3.5, Guidance Scale (ω)=4.0, NFE=1002026.01 | 22.31 | 32.54 | 30.24 | 1.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MPModel=SD3.5, Guidance Scale (ω)=4.0, NFE=1002026.01 | 22.31 | 32.54 | 30.78 | 1.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-0*Model=Flux-dev, Guidance Scale (ω)=3, NFE=1202026.01 | 22.3 | 32.53 | 30.95 | 1.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LoTTSModel=SDXL2025.11 | 22.3 | — | 28.23 | 1.102 | 6.304 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ctrl-Z‡Backbone=Hunyuan-DiT, NFEs=8.792025.06 | 22.3 | — | — | 1.441 | 6.325 | — | 30.91 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| R-CFG++Model=Flux-dev, Guidance Scale (ω)=3, NFE=1202026.01 | 22.29 | 32.52 | 30.94 | 1.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MP+Model=SD3.5, Guidance Scale (ω)=4.0, NFE=602026.01 | 22.29 | 32.55 | 30.94 | 1.16 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MP+Model=Flux-dev, Guidance Scale (ω)=3, NFE=1002026.01 | 22.28 | 32.49 | 31.15 | 1.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFGModel=Flux-dev, Guidance Scale (ω)=3, NFE=1202026.01 | 22.28 | 32.51 | 30.9 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-0*Model=SD3.5, Guidance Scale (ω)=4.0, NFE=602026.01 | 22.27 | 32.51 | 30.21 | 1.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MPModel=SD3.5, Guidance Scale (ω)=4.0, NFE=602026.01 | 22.27 | 32.54 | 30.69 | 1.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFGModel=SD3.5, Guidance Scale (ω)=4.0, NFE=1002026.01 | 22.27 | 32.51 | 30.22 | 1.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFGModel=SD3.5, Guidance Scale (ω)=4.0, NFE=602026.01 | 22.26 | 32.5 | 30.18 | 1.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MPModel=Flux-dev, Guidance Scale (ω)=3, NFE=802026.01 | 22.25 | 32.47 | 30.39 | 1.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MP+Model=Flux-dev, Guidance Scale (ω)=3, NFE=802026.01 | 22.25 | 32.45 | 30.44 | 1.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| R-CFG++Model=Flux-dev, Guidance Scale (ω)=3, NFE=1002026.01 | 22.25 | 32.51 | 30.67 | 1.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MPModel=Flux-dev, Guidance Scale (ω)=3, NFE=602026.01 | 22.24 | 32.36 | 29.91 | 0.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MP+Model=Flux-dev, Guidance Scale (ω)=3, NFE=602026.01 | 22.24 | 32.39 | 29.92 | 1.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-0*Model=Flux-dev, Guidance Scale (ω)=3, NFE=1002026.01 | 22.24 | 32.51 | 30.66 | 1.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ctrl-Z†Backbone=Hunyuan-DiT, NFEs=2.852025.06 | 22.24 | — | — | 1.214 | 6.31 | — | 30.69 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFGModel=Flux-dev, Guidance Scale (ω)=3, NFE=1002026.01 | 22.23 | 32.46 | 30.62 | 0.99 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ABSSVersion=Hunyuan DiT2026.05 | 22.2284 | 0.276 | 0.319 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.1446 | 71 | |
| RANDOMVersion=Hunyuan DiT2026.05 | 22.2266 | 0.2734 | 0.3162 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.1448 | 50 | |
| NPNETVersion=Hunyuan DiT2026.05 | 22.2203 | 0.2649 | 0.3148 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.1456 | 50 | |
| R-CFG++Model=Flux-dev, Guidance Scale (ω)=3, NFE=802026.01 | 22.22 | 32.39 | 30.3 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-0*Model=Flux-dev, Guidance Scale (ω)=3, NFE=802026.01 | 22.22 | 32.38 | 30.28 | 1.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-MPModel=Flux-dev, Guidance Scale (ω)=3, NFE=1002026.01 | 22.22 | 32.49 | 30.88 | 1.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SOP-4Backbone=Hunyuan-DiT, NFEs=9.002025.06 | 22.22 | — | — | 1.444 | 6.303 | — | 30.81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GOLDENVersion=Hunyuan DiT2026.05 | 22.2199 | 0.2738 | 0.3198 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.1443 | 209 | |
| NSVersion=Hunyuan DiT2026.05 | 22.2188 | 0.2751 | 0.3189 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.125 | 333 | |
| R-CFG++Model=Flux-dev, Guidance Scale (ω)=3, NFE=602026.01 | 22.21 | 32.34 | 29.89 | 0.99 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFGModel=Flux-dev, Guidance Scale (ω)=3, NFE=802026.01 | 22.21 | 32.38 | 30.27 | 0.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG-0*Model=Flux-dev, Guidance Scale (ω)=3, NFE=602026.01 | 22.2 | 32.34 | 29.9 | 0.91 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFGModel=Flux-dev, Guidance Scale (ω)=3, NFE=602026.01 | 22.19 | 32.32 | 29.87 | 0.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SOP-1Backbone=Hunyuan-DiT, NFEs=3.002025.06 | 22.19 | — | — | 1.232 | 6.333 | — | 30.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Z-SamplingBackbone=Hunyuan-DiT, NFEs=3.002025.06 | 22.18 | — | — | 1.111 | 6.398 | — | 30.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DDIMBackbone=Hunyuan-DiT, NFEs=1.002025.06 | 22.15 | — | — | 1.071 | 6.324 | — | 30.22 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ResamplingBackbone=Hunyuan-DiT, NFEs=2.002025.06 | 22.14 | — | — | 1.112 | 6.338 | — | 30.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ABSSVersion=3.0, k=3, seed pool size=102026.05 | 22.0831 | 0.2753 | 0.3144 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.0757 | — | |
| GOLDENVersion=3.0, k=3, seed pool size=102026.05 | 22.0813 | 0.2779 | 0.3129 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.063 | — | |
| ABSSVersion=FLUX, k=3, seed pool size=102026.05 | 22.0716 | 0.2581 | 0.3114 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.806 | — | |
| ResamplingModel=FLUX2025.11 | 22.07 | — | 29.34 | 1.038 | 6.298 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RANDOMVersion=FLUX, k=3, seed pool size=102026.05 | 22.0647 | 0.2568 | 0.3094 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.7997 | — | |
| Original (SDXL)Base Model=SDXL2026.05 | 22.06 | 36.38 | 22.71 | 0.5562 | 6.0735 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Particle SamplingModel=SDXL2025.11 | 22.05 | — | 25.33 | 0.865 | 6.235 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GOLDENVersion=FLUX, k=3, seed pool size=102026.05 | 22.0442 | 0.2572 | 0.3088 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.8161 | — | |
| Best-of-NModel=SDXL2025.11 | 22.01 | — | 24.54 | 0.79 | 6.198 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RANDOMVersion=3.0, k=3, seed pool size=102026.05 | 22.0072 | 0.275 | 0.311 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.0498 | — | |
| NoiseARModel=Hunyuan2026.03 | 21.93 | — | — | 1.037 | — | — | 30.27 | 8.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=PixArt-Σ2026.03 | 21.9 | — | — | 0.8124 | — | — | 29.83 | 8.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=PixArt-Σ2026.03 | 21.9 | — | — | 0.8124 | — | — | 29.83 | 8.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Z2-SamplingModel=SDXL2026.04 | 21.88 | — | — | 0.7663 | 6.16 | — | 31.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Naïve PAINEModel=Hunyuan2026.03 | 21.86 | — | — | 0.8952 | — | — | 30.77 | 8.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Naïve PAINEModel=Hunyuan2026.03 | 21.86 | — | — | 0.8952 | — | — | 30.77 | 8.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Golden NoiseModel=Hunyuan2026.03 | 21.85 | — | — | 0.87 | — | — | 29.94 | 8.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Golden NoiseModel=SDXL2026.03 | 21.85 | — | — | 0.6501 | — | — | 28.68 | 7.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoiseARModel=SDXL2026.03 | 21.85 | — | — | 0.7529 | — | — | 29.07 | 7.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CFG++Model=SDXL2026.04 | 21.83 | — | — | 0.673 | 6.09 | — | 30.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Naïve PAINEModel=PixArt-Σ2026.03 | 21.82 | — | — | 0.8602 | — | — | 30.82 | 8.73 | — | — | — | — | — | — | — | — | — | — | — | — | — |