Instruction-based Image Editing on InstructPE (test)
19.836PickScoreDiffChat
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DiffChatSD Model=Stable Diffusion XL 1.0, Training=Full implementation2024.03 | 19.836 | 6.781 | 21.654 | 30.392 | 18.04 | 87.314 | 1.5 | |
| DiffChatSD Model=Stable Diffusion XL 1.0, Training Strategy=Full implementation2024.03 | 19.836 | 6.781 | 21.654 | 30.392 | 18.04 | 87.314 | 1.5 | |
| DiffChatSD Model=Stable Diffusion XL 1.0, Training=SFT only2024.03 | 19.823 | 6.762 | 21.659 | 30.383 | 17.992 | 85.089 | 2.167 | |
| DiffChatSD Model=Stable Diffusion XL 1.0, Training Strategy=SFT only2024.03 | 19.823 | 6.762 | 21.659 | 30.383 | 17.992 | 85.089 | 2.167 | |
| ChatGPTSD Model=Stable Diffusion XL 1.02024.03 | 19.82 | 6.757 | 21.636 | 30.395 | 17.3 | 87.496 | 2.333 | |
| ChatGPTSD Model=Stable Diffusion XL 1.02024.03 | 19.82 | 6.757 | 21.636 | 30.395 | 17.3 | 87.496 | 2.333 | |
| DiffChatSD Model=Dreamlike, Training=Full implementation2024.03 | 19.612 | 6.511 | 21.032 | 29.723 | 17.687 | 87.314 | 1.5 | |
| ChatGPTSD Model=Dreamlike2024.03 | 19.602 | 6.501 | 21.01 | 29.692 | 16.863 | 87.496 | 2.333 | |
| DiffChatSD Model=Dreamlike, Training=SFT only2024.03 | 19.602 | 6.487 | 21.042 | 29.686 | 17.592 | 85.089 | 2.5 | |
| DiffChatSD Model=Deliberate, Training=Full implementation2024.03 | 19.6 | 6.335 | 20.78 | 29.101 | 16.214 | 87.314 | 1.333 | |
| DiffChatBase SD Model=Deliberate, Implementation Strategy=Full implementation2024.03 | 19.6 | 6.335 | 20.78 | 29.101 | 16.214 | 87.314 | 1.333 | |
| ChatGPTSD Model=Deliberate2024.03 | 19.59 | 6.312 | 20.755 | 28.982 | 14.994 | 87.496 | 2.5 | |
| DiffChatSD Model=Deliberate, Training=SFT only2024.03 | 19.59 | 6.311 | 20.76 | 29.051 | 15.842 | 85.089 | 2.5 | |
| ChatGPTBase SD Model=Deliberate2024.03 | 19.59 | 6.312 | 20.755 | 28.982 | 14.994 | 87.496 | 2.5 | |
| DiffChatBase SD Model=Deliberate, Implementation Strategy=SFT only2024.03 | 19.59 | 6.311 | 20.76 | 29.051 | 15.842 | 85.089 | 2.5 | |
| DiffChatmode=Full implementation2024.03 | 19.584 | 6.416 | 20.851 | 29.397 | 16.787 | 87.314 | 1.333 | |
| DiffChatmode=SFT only2024.03 | 19.571 | 6.392 | 20.836 | 29.35 | 16.596 | 85.089 | 2.667 | |
| ChatGPT2024.03 | 19.569 | 6.394 | 20.822 | 29.354 | 15.802 | 87.496 | 2.5 | |
| DiffChatSD Model Backend=Realistic, Implementation=Full implementation2024.03 | 19.513 | 6.283 | 20.622 | 28.945 | 16.242 | 87.314 | 1.333 | |
| DiffChatSD Model=Realistic, Training=Full implementation2024.03 | 19.513 | 6.283 | 20.622 | 28.945 | 16.242 | 87.314 | 1.333 | |
| DiffChatSD Model Backend=Realistic, Implementation=SFT only2024.03 | 19.5 | 6.249 | 20.589 | 28.857 | 16.018 | 85.089 | 2.667 | |
| DiffChatSD Model=Realistic, Training=SFT only2024.03 | 19.5 | 6.249 | 20.589 | 28.857 | 16.018 | 85.089 | 2.667 | |
| ChatGPTSD Model Backend=Realistic2024.03 | 19.494 | 6.254 | 20.586 | 28.863 | 15.258 | 87.496 | 2.5 | |
| ChatGPTSD Model=Realistic2024.03 | 19.494 | 6.254 | 20.586 | 28.863 | 15.258 | 87.496 | 2.5 | |
| InstructPix2PixSD Model=Stable Diffusion XL 1.02024.03 | 19.468 | 4.603 | 16.381 | 13.313 | 5.117 | — | 4 | |
| InstructPix2PixSD Model=Stable Diffusion XL 1.02024.03 | 19.468 | 4.603 | 16.381 | 13.313 | 5.117 | — | 4 | |
| InstructPix2PixSD Model=Deliberate2024.03 | 19.363 | 6.082 | 19.913 | 25.209 | 20.602 | — | 3.4 | |
| InstructPix2PixBase SD Model=Deliberate2024.03 | 19.363 | 6.082 | 19.913 | 25.209 | 20.602 | — | 3.4 | |
| DiffChatSD Model=Stable Diffusion 1.5, Training=Full implementation2024.03 | 19.359 | 6.169 | 20.163 | 28.822 | 15.747 | 87.314 | 1.5 | |
| InstructPix2PixSD Model=Dreamlike2024.03 | 19.349 | 5.977 | 19.672 | 25.175 | 19.309 | — | 3.4 | |
| InstructPix2Pix2024.03 | 19.346 | 5.726 | 19.036 | 22.67 | 17.327 | — | 3.4 | |
| DiffChatSD Model=Stable Diffusion 1.5, Training=SFT only2024.03 | 19.339 | 6.149 | 20.129 | 28.769 | 15.532 | 85.089 | 2.5 | |
| ChatGPTSD Model=Stable Diffusion 1.52024.03 | 19.338 | 6.145 | 20.123 | 28.837 | 14.594 | 87.496 | 2.5 | |
| InstructPix2PixSD Model Backend=Realistic2024.03 | 19.313 | 6.052 | 19.784 | 25.072 | 20.79 | — | 3.4 | |
| InstructPix2PixSD Model=Realistic2024.03 | 19.313 | 6.052 | 19.784 | 25.072 | 20.79 | — | 3.4 | |
| InstructPix2PixSD Model=Stable Diffusion 1.52024.03 | 19.235 | 5.917 | 19.43 | 24.58 | 20.818 | — | 3.4 |