Text-to-Image Generation on HPS v2
34.44HPSv2.1 ScoreNaïve PAINE
Evaluation results
| Method | Links | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Naïve PAINEModel=DreamShaper2026.03 | 34.44 | — | — | — | 123.24 | 23.44 | — | — | — | 13.94 | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=DreamShaper2026.03 | 34.39 | — | — | — | 121.91 | 23.42 | — | — | — | 13.9 | — | — | — | — | — | — | — | — | — | — | — | |
| Naïve PAINEModel=PixArt-Σ2026.03 | 31.79 | — | — | — | 103.23 | 22.7 | — | — | — | 11.96 | — | — | — | — | — | — | — | — | — | — | — | |
| Naïve PAINEModel=Hunyuan2026.03 | 31.7 | — | — | — | 108.42 | 22.58 | — | — | — | 11.43 | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=PixArt-Σ2026.03 | 31.7 | — | — | — | 103.21 | 22.68 | — | — | — | 11.93 | — | — | — | — | — | — | — | — | — | — | — | |
| Original SD3.5 Large TurboModel=SD3.5 Large Turbo, Memory=15.8 (100%), Reduction=-2025.08 | 30.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OriginalModel=SD3.5 Large Turbo, Memory (%)=(100%)2025.08 | 30.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=Hunyuan2026.03 | 30.06 | — | — | — | 106.41 | 22.58 | — | — | — | 11.42 | — | — | — | — | — | — | — | — | — | — | — | |
| Original FLUX.1 SchnellModel=FLUX.1 Schnell, Memory=22.6 (100%), Reduction=-2025.08 | 29.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OriginalModel=FLUX.1 Schnell, Memory (%)=(100%)2025.08 | 29.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Golden NoiseModel=DreamShaper2026.03 | 29.7 | — | — | — | 123.66 | 23.39 | — | — | — | 14.19 | — | — | — | — | — | — | — | — | — | — | — | |
| SANA-SprintModel=Linear DiT, Memory=3.14 (100%), Reduction=-2025.08 | 29.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SANA-SprintModel=Linear DiT, Memory (%)=(100%)2025.08 | 29.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Diff.-NPOBase Model=SDXL2026.05 | 29.42 | — | 38.75 | 6.4344 | 1.3319 | 23.49 | — | — | — | — | — | 83.65 | 88.6 | 50.69 | 88.6 | 75.1 | 77.33 | — | — | — | — | |
| Online-DPOBase Model=SDXL2026.05 | 29.17 | — | 38.92 | 6.3367 | 1.2205 | 23.46 | — | — | — | — | — | 84.8 | 84.75 | 52.65 | 83.35 | 70.55 | 75.22 | — | — | — | — | |
| Golden NoiseModel=Hunyuan2026.03 | 29 | — | — | — | 108.25 | 22.61 | — | — | — | 11.7 | — | — | — | — | — | — | — | — | — | — | — | |
| Hierarchical Position Pruning + PWPModel=SD3.5 Large Turbo, Memory (%)=(79.4%)2025.08 | 28.97 | — | — | — | — | — | — | — | 2.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Golden NoiseModel=PixArt-Σ2026.03 | 28.95 | — | — | — | 97.96 | 22.52 | — | — | — | 11.56 | — | — | — | — | — | — | — | — | — | — | — | |
| Golden NoiseModel=SDXL2026.03 | 28.74 | — | — | — | 91.07 | 22.6 | — | — | — | 10.78 | — | — | — | — | — | — | — | — | — | — | — | |
| HierarchicalPrune (All)Model=FLUX.1 Schnell, Memory=4.44 (19.6%), Reduction=3.2%2025.08 | 28.69 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HierarchicalPrune (All)Model=FLUX.1 Schnell, Memory (%)=(19.6%)2025.08 | 28.69 | — | — | — | — | — | — | — | 3.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=SDXL2026.03 | 28.69 | — | — | — | 85.06 | 22.52 | — | — | — | 10.24 | — | — | — | — | — | — | — | — | — | — | — | |
| Naïve PAINEModel=SDXL2026.03 | 28.67 | — | — | — | 92.37 | 23.01 | — | — | — | 10.21 | — | — | — | — | — | — | — | — | — | — | — | |
| Original (SDXL)Base Model=SDXL2026.05 | 28.18 | — | 38.64 | 6.1155 | 0.7526 | 22.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HierarchicalPrune (HPP+PWP+Q)Model=SD3.5 Large Turbo, Memory=3.56 (22.5%), Reduction=4.8%2025.08 | 28.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Hierarchical Position Pruning + PWP + QuantizationModel=SD3.5 Large Turbo, Memory (%)=(22.5%)2025.08 | 28.15 | — | — | — | — | — | — | — | 4.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Online-SFTBase Model=SDXL2026.05 | 27.84 | — | 38.62 | 6.0088 | 0.7715 | 22.25 | — | — | — | — | — | 21.85 | 34.7 | 48.2 | 47.25 | 35.75 | 37.55 | — | — | — | — | |
| BK-SDMModel=FLUX.1 Schnell, Memory=15.9 (70.5%), Reduction=19.8%2025.08 | 27.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BK-SDMModel=FLUX.1 Schnell, Memory (%)=(70.5%)2025.08 | 27.38 | — | — | — | — | — | — | — | 19.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Sensitivity-Guided Distillation (SGDistill)Model=SD3.5 Large Turbo, Memory (%)=(71.5%)2025.08 | 27.29 | — | — | — | — | — | — | — | 10.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| HierarchicalPrune (All)Model=SD3.5 Large Turbo, Memory=3.24 (20.5%), Reduction=13.3%2025.08 | 26.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HierarchicalPrune (+Quant, All)Model=SD3.5 Large Turbo, Memory (%)=(20.5%)2025.08 | 26.29 | — | — | — | — | — | — | — | 13.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| KOALAModel=FLUX.1 Schnell, Memory=15.9 (70.5%), Reduction=28.7%2025.08 | 25.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KOALAModel=FLUX.1 Schnell, Memory (%)=(70.5%)2025.08 | 25.24 | — | — | — | — | — | — | — | 28.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Hierarchical Position Pruning + PWPModel=SD3.5 Large Turbo, Memory (%)=(71.5%)2025.08 | 21.74 | — | — | — | — | — | — | — | 31.9 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BK-SDMModel=SD3.5 Large Turbo, Memory=12.6 (79.4%), Reduction=38.2%2025.08 | 21.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BK-SDMModel=SD3.5 Large Turbo, Memory (%)=(79.4%)2025.08 | 21.21 | — | — | — | — | — | — | — | 38.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| KOALAModel=SD3.5 Large Turbo, Memory=12.6 (79.4%), Reduction=41.2%2025.08 | 19.99 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KOALAModel=SD3.5 Large Turbo, Memory (%)=(79.4%)2025.08 | 19.99 | — | — | — | — | — | — | — | 41.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BK-SDM (+Quant)Model=SD3.5 Large Turbo, Memory=3.56 (22.5%), Reduction=43.3%2025.08 | 19.83 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BK-SDM (+Quant)Model=SD3.5 Large Turbo, Memory (%)=(22.5%)2025.08 | 19.83 | — | — | — | — | — | — | — | 43.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| KOALA (+Quant)Model=SD3.5 Large Turbo, Memory=3.56 (22.5%), Reduction=46.4%2025.08 | 18.44 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KOALA (+Quant)Model=SD3.5 Large Turbo, Memory (%)=(22.5%)2025.08 | 18.44 | — | — | — | — | — | — | — | 46.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Hierarchical Position Pruning (HPP)Model=SD3.5 Large Turbo, Memory (%)=(79.4%)2025.08 | 11.08 | — | — | — | — | — | — | — | 79.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Hierarchical Position Pruning (HPP)Model=SD3.5 Large Turbo, Memory (%)=(71.5%)2025.08 | 7 | — | — | — | — | — | — | — | 88.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pro-GRPOVersion=Standard, G_max=48, Pruning path=48 -> 24 -> 122025.12 | 0.344 | — | — | 6.375 | 1.509 | 24.008 | — | 1.26 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pro-GRPO-FlashG_max=24, Pruning path=24 -> 16 -> 122025.12 | 0.34 | — | — | 6.303 | 1.495 | 23.722 | — | 1.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Flow-GRPOG=24, T=102025.12 | 0.338 | — | — | 6.232 | 1.463 | 23.322 | — | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SD 3.5-MVersion=Base2025.12 | 0.308 | — | — | 5.868 | 1.174 | 22.608 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Semi-DPOModel Architecture=SDXL2026.04 | 0.301 | — | 0.302 | 6.269 | 1.095 | 22.816 | — | — | — | — | 15.001 | — | — | — | — | — | — | — | — | — | — | |
| Diff-DPOModel Architecture=SDXL2026.04 | 0.298 | — | 0.307 | 6.163 | 1.07 | 22.953 | — | — | — | — | 14.831 | — | — | — | — | — | — | — | — | — | — | |
| ArenaPOBackbone=Stable Diffusion XL2026.05 | 0.2945 | — | 0.3899 | 6.1685 | 1.0438 | 0.2319 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SDPOBackbone=Stable Diffusion XL2026.05 | 0.2938 | — | 0.3879 | 6.1284 | 1.0326 | 0.2308 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MaPOBackbone=Stable Diffusion XL2026.05 | 0.2934 | — | 0.384 | 6.1882 | 0.9703 | 0.2293 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Diff.-DPOBackbone=Stable Diffusion XL2026.05 | 0.2927 | — | 0.384 | 6.138 | 1.0159 | 0.2288 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MaPOModel Architecture=SDXL2026.04 | 0.292 | — | 0.303 | 6.244 | 0.96 | 22.682 | — | — | — | — | 14.635 | — | — | — | — | — | — | — | — | — | — | |
| DSPOBackbone=Stable Diffusion XL2026.05 | 0.2916 | — | 0.3894 | 6.0424 | 1.0054 | 0.2273 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pre-TrainedBackbone=Stable Diffusion XL2026.05 | 0.29 | — | 0.3847 | 6.1271 | 0.9047 | 0.229 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SFTBackbone=Stable Diffusion XL2026.05 | 0.2883 | — | 0.3806 | 5.9689 | 0.8528 | 0.2228 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Semi-DPOModel Architecture=SD1.52026.04 | 0.287 | — | 0.299 | 5.899 | 0.816 | 21.945 | — | — | — | — | 13.514 | — | — | — | — | — | — | — | — | — | — | |
| ArenaPOBackbone=Stable Diffusion 1.52026.05 | 0.2842 | — | 0.3619 | 5.8591 | 0.6881 | 0.2184 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Diff-KTOModel Architecture=SD1.52026.04 | 0.284 | — | 0.298 | 5.803 | 0.69 | 21.454 | — | — | — | — | 13.016 | — | — | — | — | — | — | — | — | — | — | |
| SFTBackbone=Stable Diffusion 1.52026.05 | 0.2838 | — | 0.3591 | 5.7851 | 0.6619 | 0.2168 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DSPOBackbone=Stable Diffusion 1.52026.05 | 0.2837 | — | 0.3598 | 5.8346 | 0.6483 | 0.2168 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SDPOBackbone=Stable Diffusion 1.52026.05 | 0.2827 | — | 0.36 | 5.8744 | 0.6211 | 0.2174 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SDXLModel Architecture=SDXL2026.04 | 0.28 | — | 0.301 | 6.127 | 0.839 | 22.611 | — | — | — | — | 14.472 | — | — | — | — | — | — | — | — | — | — | |
| MaPOBackbone=Stable Diffusion 1.52026.05 | 0.276 | — | 0.3528 | 5.689 | 0.3308 | 0.2124 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Diff.-DPOBackbone=Stable Diffusion 1.52026.05 | 0.2743 | — | 0.3552 | 5.6639 | 0.1705 | 0.2131 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pre-TrainedBackbone=Stable Diffusion 1.52026.05 | 0.2697 | — | 0.348 | 5.4933 | -0.0469 | 0.2088 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Diff-DPOModel Architecture=SD1.52026.04 | 0.259 | — | 0.297 | 5.714 | 0.339 | 21.308 | — | — | — | — | 12.739 | — | — | — | — | — | — | — | — | — | — | |
| SD1.5Model Architecture=SD1.52026.04 | 0.246 | — | 0.293 | 5.578 | 0.139 | 20.862 | — | — | — | — | 12.211 | — | — | — | — | — | — | — | — | — | — | |
| DanceGRPOReward=HPS2025.12 | — | 0.369 | — | 6.229 | 1.079 | 22.127 | 0.366 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DanceGRPOReward=HPS+CLIP2025.12 | — | — | 0.575 | 6.212 | 1.057 | 22.102 | 0.367 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DanceGRPOReward Model=HPS-v22026.06 | — | 0.343 | 0.3724 | — | 1.2178 | — | — | — | — | 14.4687 | — | — | — | — | — | — | — | 3.2291 | 3.6253 | 3.3089 | 3.5129 | |
| DanceGRPOReward Model=HPS-v32026.06 | — | 0.3275 | 0.3813 | — | 1.1431 | — | — | — | — | 14.6675 | — | — | — | — | — | — | — | 3.2345 | 3.645 | 3.2843 | 3.546 | |
| DanceGRPOReward Model=HPS-v3 + CLIP2026.06 | — | 0.3189 | 0.3914 | — | 1.1406 | — | — | — | — | 13.8573 | — | — | — | — | — | — | — | 3.2483 | 3.6294 | 3.2499 | 3.5859 | |
| DanceGRPO + AdaGRPOReward Model=HPS-v22026.06 | — | 0.3516 | 0.3685 | — | 1.2539 | — | — | — | — | 14.5155 | — | — | — | — | — | — | — | 3.2209 | 3.6584 | 3.3891 | 3.5355 | |
| DanceGRPO + AdaGRPOReward Model=HPS-v32026.06 | — | 0.3301 | 0.378 | — | 1.1487 | — | — | — | — | 14.9501 | — | — | — | — | — | — | — | 3.2266 | 3.6724 | 3.3052 | 3.5376 | |
| DanceGRPO + AdaGRPOReward Model=HPS-v3 + CLIP2026.06 | — | 0.3246 | 0.3924 | — | 1.2216 | — | — | — | — | 14.3156 | — | — | — | — | — | — | — | 3.2514 | 3.6357 | 3.25 | 3.6203 | |
| Flow-CPSReward Model=HPS-v22026.06 | — | 0.3492 | 0.3745 | — | 1.2561 | — | — | — | — | 14.8044 | — | — | — | — | — | — | — | 3.2387 | 3.666 | 3.3679 | 3.5276 | |
| Flow-CPSReward Model=HPS-v32026.06 | — | 0.3291 | 0.3783 | — | 1.1598 | — | — | — | — | 14.7578 | — | — | — | — | — | — | — | 3.2312 | 3.655 | 3.2786 | 3.5375 | |
| Flow-CPSReward Model=HPS-v3 + CLIP2026.06 | — | 0.3252 | 0.3926 | — | 1.2222 | — | — | — | — | 14.3248 | — | — | — | — | — | — | — | 3.2608 | 3.618 | 3.2358 | 3.6339 | |
| Flow-CPS + AdaGRPOReward Model=HPS-v22026.06 | — | 0.3579 | 0.3691 | — | 1.2575 | — | — | — | — | 14.9521 | — | — | — | — | — | — | — | 3.2264 | 3.6676 | 3.3722 | 3.5537 | |
| Flow-CPS + AdaGRPOReward Model=HPS-v32026.06 | — | 0.3311 | 0.3734 | — | 1.1548 | — | — | — | — | 15.1093 | — | — | — | — | — | — | — | 3.2169 | 3.6823 | 3.3133 | 3.5193 | |
| Flow-CPS + AdaGRPOReward Model=HPS-v3 + CLIP2026.06 | — | 0.3286 | 0.3942 | — | 1.23 | — | — | — | — | 14.6044 | — | — | — | — | — | — | — | 3.2642 | 3.6338 | 3.2475 | 3.6419 | |
| Flow-GRPOReward Model=HPS-v22026.06 | — | 0.3463 | 0.3754 | — | 1.2435 | — | — | — | — | 14.4374 | — | — | — | — | — | — | — | 3.2293 | 3.6236 | 3.3395 | 3.5167 | |
| Flow-GRPOReward Model=HPS-v32026.06 | — | 0.3272 | 0.3787 | — | 1.1475 | — | — | — | — | 14.7143 | — | — | — | — | — | — | — | 3.23 | 3.6728 | 3.2836 | 3.5821 | |
| Flow-GRPOReward Model=HPS-v3 + CLIP2026.06 | — | 0.325 | 0.3938 | — | 1.1988 | — | — | — | — | 14.2459 | — | — | — | — | — | — | — | 3.2605 | 3.6231 | 3.2487 | 3.626 | |
| Flow-GRPO + AdaGRPOReward Model=HPS-v22026.06 | — | 0.3558 | 0.3676 | — | 1.2645 | — | — | — | — | 14.887 | — | — | — | — | — | — | — | 3.2222 | 3.6595 | 3.384 | 3.5285 | |
| Flow-GRPO + AdaGRPOReward Model=HPS-v32026.06 | — | 0.3319 | 0.3699 | — | 1.149 | — | — | — | — | 15.0982 | — | — | — | — | — | — | — | 3.2018 | 3.6774 | 3.3154 | 3.5512 | |
| Flow-GRPO + AdaGRPOReward Model=HPS-v3 + CLIP2026.06 | — | 0.3288 | 0.3952 | — | 1.2018 | — | — | — | — | 14.6114 | — | — | — | — | — | — | — | 3.2566 | 3.6418 | 3.2511 | 3.634 | |
| Flux.1-devReward Model=/2026.06 | — | 0.3065 | 0.3901 | — | 1.0546 | — | — | — | — | 13.2803 | — | — | — | — | — | — | — | 3.255 | 3.6547 | 3.2333 | 3.6006 | |
| Pro-GRPOReward=HPS2025.12 | — | 0.391 | — | 6.253 | 1.114 | 22.202 | 0.383 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pro-GRPOReward=HPS+CLIP2025.12 | — | — | 0.596 | 6.273 | 1.14 | 22.271 | 0.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SD v1.4Model Version=Base2025.12 | — | — | — | 5.389 | 0.015 | 20.688 | 0.239 | — | — | — | — | — | — | — | — | — | — | — | — | — | — |