Multi-turn Image Editing on EdiVal 1.0 (test)
75.93EdiVal-IF (T1)Seedream 4.0
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Seedream 4.0Technique=Unknown, In-Context=false, Date=25.09.10, Source=close-sourced2025.09 | 75.93 | 14.55 | 55.58 | 41.59 | 92.51 | 88.03 | 85.86 | 83.81 | 69.95 | 59.76 | 1 | — | — | — | |
| FLUX.2-maxTechnique=Flow Matching, In-Context=false, Date=25.12.16, Source=close-sourced2025.09 | 75.55 | 36.87 | 55.27 | 39.36 | 92.91 | 88.3 | 85.78 | 83.78 | 69.86 | 58.1 | 4 | — | — | — | |
| GPT-Image-1.5Technique=Unknown, In-Context=true, Date=25.12.16, Source=close-sourced2025.09 | 75.19 | 35.55 | 55.92 | 40.08 | 94.49 | 91.2 | 88.49 | 84.29 | 71.41 | 59.55 | 2 | — | — | — | |
| Nano Banana 2Technique=Unknown, In-Context=true, Date=26.03.01, Source=close-sourced2025.09 | 73.89 | 23.79 | 54.17 | 38.61 | 93.54 | 90.52 | 88.61 | 83.14 | 70.02 | 58.49 | 3 | — | — | — | |
| GPT-Image-1Technique=Unknown, In-Context=true, Date=25.07.16, Source=close-sourced2025.09 | 73.12 | 26.47 | 54.89 | 38.35 | 81 | 77.78 | 75.5 | 76.96 | 65.34 | 53.81 | 6 | — | — | — | |
| Qwen-Image-EditTechnique=Flow Matching, In-Context=false, Date=25.08.04, Source=open-sourced2025.09 | 72.9 | 115.08 | 44.06 | 22.55 | 84.22 | 80.52 | 77.98 | 78.36 | 59.56 | 41.93 | 9 | — | — | — | |
| Nano BananaTechnique=Unknown, In-Context=true, Date=25.08.26, Source=close-sourced2025.09 | 70.7 | 9.2 | 50.66 | 35.35 | 93.91 | 90.48 | 89.48 | 81.48 | 67.7 | 56.24 | 5 | — | — | — | |
| FLUX.1-Kontext-maxTechnique=Flow Matching, In-Context=false, Date=25.06.03, Source=close-sourced2025.09 | 69.49 | 10.13 | 46.89 | 31.83 | 93.93 | 90.9 | 88.4 | 80.79 | 65.29 | 53.04 | 7 | — | — | — | |
| Gemini 2.0 FlashTechnique=Unknown, In-Context=true, Date=25.02.05, Source=close-sourced2025.09 | 68.07 | 8.34 | 45.96 | 28.42 | 90.58 | 85.1 | 80.88 | 78.52 | 62.54 | 47.94 | 8 | — | — | — | |
| Step1X-EditTechnique=Flow Matching, In-Context=false, Date=25.04.25, Source=open-sourced2025.09 | 61.89 | 20.42 | 34.97 | 17.83 | 92.76 | 88.52 | 85.21 | 75.77 | 55.64 | 38.98 | 10 | — | — | — | |
| FLUX.1-Kontext-devTechnique=Flow Matching, In-Context=false, Date=25.06.25, Source=open-sourced2025.09 | 59.97 | 29.21 | 32.69 | 16.61 | 95.32 | 92.24 | 90.22 | 75.61 | 54.91 | 38.71 | 11 | — | — | — | |
| Edit-R22026.06 | 57.99 | — | 35.14 | 18.53 | 88.1 | 78.53 | 72.04 | — | — | — | — | 73.05 | 56.84 | 45.29 | |
| BAGEL2026.06 | 56.47 | — | 33.39 | 16.43 | 88.38 | 79.29 | 72.95 | — | — | — | — | 72.43 | 56.34 | 44.69 | |
| OmniGenTechnique=Flow Matching, In-Context=false, Date=24.09.11, Source=open-sourced2025.09 | 54.72 | 19.7 | 24.48 | 10.66 | 93 | 88.42 | 83.92 | 71.34 | 46.52 | 29.91 | 12 | — | — | — | |
| UltraEditTechnique=Diffusion, In-Context=false, Date=24.07.07, Source=open-sourced2025.09 | 51.37 | 3.15 | 17.7 | 6.36 | 86.8 | 84.5 | 82.4 | 66.78 | 38.67 | 22.89 | 13 | — | — | — | |
| MagicBrushTechnique=Diffusion, In-Context=false, Date=23.06.16, Source=open-sourced2025.09 | 42.31 | 4.08 | 15.73 | 4.9 | 86.96 | 81.26 | 76.86 | 60.66 | 35.75 | 19.41 | 15 | — | — | — | |
| AnyEditTechnique=Diffusion, In-Context=false, Date=24.11.24, Source=open-sourced2025.09 | 41.07 | 3.93 | 16.32 | 7.22 | 86.42 | 78.91 | 70.1 | 59.58 | 35.89 | 22.5 | 14 | — | — | — | |
| IP2PTechnique=Diffusion, In-Context=false, Date=23.12.15, Source=open-sourced2025.09 | 37.41 | 4.09 | 10.66 | 2.8 | 76.85 | 68.36 | 60.3 | 53.62 | 26.99 | 12.99 | 16 | — | — | — |