Text-to-Image Preference Alignment on FiFA-5K (test)
22.84PickScoreDPO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DPOModel=SDXL, # Pref. pairs=5000, # Unpref. pairs=0, Configuration=100%2026.02 | 22.84 | 28.76 | 5.77 | |
| DeDPOModel=SDXL, # Pref. pairs=1250, # Unpref. pairs=3750, Configuration=synthetic pref.2026.02 | 22.83 | 28.76 | 5.77 | |
| DPOModel=SDXL, # Pref. pairs=1250, # Unpref. pairs=3750, Configuration=synthetic pref.2026.02 | 22.61 | 28.71 | 5.66 | |
| DPOModel=SDXL, # Pref. pairs=1250, # Unpref. pairs=0, Configuration=25%2026.02 | 22.57 | 28.34 | 5.66 | |
| SFTModel=SDXL, # Pref. pairs=1250, # Unpref. pairs=02026.02 | 22.01 | 27.87 | 5.6 | |
| DeDPOModel=SD1.5, # Pref. pairs=1250, # Unpref. pairs=3750, Configuration=synthetic pref.2026.02 | 21.91 | 27.8 | 5.43 | |
| DPOModel=SD1.5, # Pref. pairs=5000, # Unpref. pairs=0, Configuration=100%2026.02 | 21.88 | 27.79 | 5.38 | |
| DPOModel=SD1.5, # Pref. pairs=1250, # Unpref. pairs=0, Configuration=25%2026.02 | 21.76 | 27.76 | 5.38 | |
| DPOModel=SD1.5, # Pref. pairs=1250, # Unpref. pairs=3750, Configuration=synthetic pref.2026.02 | 21.71 | 27.39 | 5.33 | |
| SFTModel=SD1.5, # Pref. pairs=1250, # Unpref. pairs=02026.02 | 21.64 | 27.62 | 5.43 |