Text-to-Image Generation on Preference Evaluation Suite v2.1
0.361HPSv2.1MixGRPO
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| MixGRPOReward=HPSv2.1, Base framework=GRPO-Based2026.02 | 0.361 | 1.201 | 0.222 | 5.833 | 0.346 | 3.293 | 3.401 | 2.094 | |
| MixGRPO w/ ConsistentRFTReward=HPSv2.1, Base framework=GRPO-Based2026.02 | 0.354 | 1.323 | 0.228 | 6.052 | 0.374 | 3.328 | 3.432 | 2.156 | |
| DanceGRPO (HPSv2.1)Reward=HPSv2.1, Base framework=GRPO-Based2026.02 | 0.353 | 1.155 | 0.226 | 5.897 | 0.361 | 3.3 | 3.379 | 2.096 | |
| DanceGRPO (HPSv2.1) w/ ConsistentRFTReward=HPSv2.1, Base framework=GRPO-Based2026.02 | 0.348 | 1.295 | 0.23 | 6.197 | 0.384 | 3.408 | 3.622 | 2.212 | |
| PrefGRPOReward=HPSv2.1, Base framework=GRPO-Based2026.02 | 0.346 | 1.172 | 0.227 | 5.953 | 0.378 | 3.338 | 3.486 | 2.129 | |
| D3POReward=HPSv2.1, Base framework=DPO-Based2026.02 | 0.338 | 1.185 | 0.227 | 5.849 | 0.379 | 3.396 | 3.507 | 2.126 | |
| DanceGRPO (CLIP+HPSv2.1)Reward=CLIP+HPSv2.1, Base framework=GRPO-Based2026.02 | 0.336 | 1.124 | 0.229 | 5.746 | 0.407 | 3.333 | 3.491 | 2.095 | |
| DPO w/ ConsistentRFTReward=HPSv2.1, Base framework=DPO-Based2026.02 | 0.334 | 1.249 | 0.232 | 6.077 | 0.394 | 3.499 | 3.57 | 2.194 | |
| DanceGRPO (CLIP+HPSv2.1) w/ ConsistentRFTReward=CLIP+HPSv2.1, Base framework=GRPO-Based2026.02 | 0.329 | 1.349 | 0.235 | 6.057 | 0.401 | 3.493 | 3.612 | 2.211 | |
| FlowGRPOReward=HPSv2.1, Base framework=GRPO-Based2026.02 | 0.326 | 1.135 | 0.226 | 5.926 | 0.375 | 3.32 | 3.476 | 2.112 | |
| DDPO w/ ConsistentRFTReward=HPSv2.1, Base framework=DDPO-Based2026.02 | 0.324 | 1.197 | 0.228 | 5.998 | 0.396 | 3.476 | 3.593 | 2.173 | |
| Diffusion-DPOReward=HPSv2.1, Base framework=DPO-Based2026.02 | 0.318 | 1.177 | 0.23 | 5.967 | 0.393 | 3.424 | 3.528 | 2.148 | |
| DDPOReward=HPSv2.1, Base framework=DDPO-Based2026.02 | 0.313 | 1.129 | 0.227 | 5.896 | 0.391 | 3.387 | 3.568 | 2.13 | |
| Flux Dev (Base)Reward=None2026.02 | 0.312 | 1.089 | 0.226 | 5.837 | 0.388 | 3.365 | 3.52 | 2.105 |