Prompt Refinement on SD 1.4 (In-distribution)
0.346ImageReward (Anime)PRIP
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PRIPRefinement=PRIP, Base Model=Stable Diffusion 1.42024.06 | 0.346 | 0.443 | 0.576 | 0.252 | 27.97 | 27.45 | 27.65 | 28.03 | 1.45 | 7,300 | 94 | |
| Rew-Syn+RLRefinement=Rew-Syn+RL, Base Model=Stable Diffusion 1.42024.06 | 0.079 | 0.135 | 0.246 | 0.138 | 27.46 | 26.85 | 26.99 | 27.7 | 1.31 | 4,000 | 89 | |
| Rew-LogRefinement=Rew-Log, Base Model=Stable Diffusion 1.42024.06 | 0.066 | 0.151 | 0.173 | 0.063 | 27.44 | 26.87 | 26.86 | 27.51 | — | — | — | |
| SD1.4Refinement=None (Baseline), Base Model=Stable Diffusion 1.42024.06 | 0.038 | 0.185 | 0.19 | 0.13 | 27.42 | 26.86 | 26.86 | 27.57 | 1.38 | 100 | 100 | |
| Rew-Log+RLRefinement=Rew-Log+RL, Base Model=Stable Diffusion 1.42024.06 | 0.028 | 0.177 | 0.187 | 0.105 | 27.42 | 26.85 | 26.86 | 27.55 | 1.33 | 600 | 96 | |
| PromptistRLRefinement=PromptistRL, Base Model=Stable Diffusion 1.42024.06 | -0.009 | 0.092 | 0.211 | -0.06 | 27.29 | 26.73 | 26.89 | 26.97 | 1.2 | 3,800 | 84 | |
| Rew-SynRefinement=Rew-Syn, Base Model=Stable Diffusion 1.42024.06 | -0.015 | 0.056 | 0.223 | -0.221 | 27.35 | 26.79 | 26.99 | 26.96 | — | — | — | |
| GPT3.5Refinement=GPT-3.5, Base Model=Stable Diffusion 1.42024.06 | -0.037 | 0.03 | 0.126 | -0.005 | 27.36 | 26.77 | 26.87 | 27.41 | — | — | — | |
| PromptistSFTRefinement=PromptistSFT, Base Model=Stable Diffusion 1.42024.06 | -0.14 | -0.083 | 0.01 | -0.287 | 27.19 | 26.6 | 26.77 | 26.88 | — | — | — | |
| GPT4Refinement=GPT-4, Base Model=Stable Diffusion 1.42024.06 | -0.143 | -0.024 | 0.03 | -0.196 | 27.29 | 26.71 | 26.76 | 27.28 | — | — | — |