ResearchBenchmarksHuman Preference Alignment on PickScore (Comprehensive Metrics)Human Preference Alignment on PickScore (Comprehensive Metrics)Follow23.55PickScore (Task)VGPO21.646822.140922.63523.1291Dec 13, 2025Evaluation resultsMethodMethodLinksPickScore (Task)Aesthetic ScoreDeQA ScoreImageRewardPickScore (Preference)UnifiedRewardVGPOKL Regularization=w/o KLKL Regularization=w/o KL2025.1223.555.974.1812823.73.34Flow-GRPOKL Regularization=w/o KLKL Regularization=w/o KL2025.1223.416.154.1612423.563.33VGPOKL Regularization=w/ KLKL Regularization=w/ KL2025.1223.415.94.2313223.613.39Flow-GRPOKL Regularization=w/ KLKL Regularization=w/ KL2025.1223.315.924.2212823.533.38SD3.5-M2025.1221.725.394.078722.343.07