ResearchBenchmarksHuman Preference Alignment on HPDv2Human Preference Alignment on HPDv2Follow0.3735HPS-v2.1TreeGRPO0.268460.295730.3230.35027Dec 9, 2025Evaluation resultsMethodMethodLinksHPS-v2.1ImageRewardAesthetic ScoreClipScoreTreeGRPOIter. Time (s)=72Iter. Time (s)=722025.120.37351.32946.50940.3703MixGRPOIter. Time (s)=145.4Iter. Time (s)=145.42025.120.36491.22636.42950.3612DanceGRPOIter. Time (s)=173.5Iter. Time (s)=173.52025.120.35561.36686.3080.3769DDPOIter. Time (s)=166.1Iter. Time (s)=166.12025.120.27581.00675.94580.39SD3.5-M2025.120.27250.8875.95190.3996