Image Editing on PhyEditBench 1.0 (normal data)
8.51Overall ScoreChronoEdit-14B
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ChronoEdit-14BSource Category=video-based2026.06 | 8.51 | 9.67 | 7.98 | 8.42 | 8.13 | 8.38 | 8.74 | 8.32 | 8.79 | 8.64 | 8.68 | 8.51 | 8.49 | 8.23 | |
| Seedream4.0Source Category=closed-source2026.06 | 8.47 | 9.69 | 8.22 | 8.22 | 7.75 | 7.43 | 9.04 | 8.65 | 8.84 | 8.6 | 8.6 | 8.74 | 8.27 | 8.15 | |
| GPT-Image-1.5Source Category=closed-source2026.06 | 8.23 | 8.84 | 8.21 | 8.3 | 6.78 | 8.36 | 8.3 | 7.91 | 8.51 | 8.16 | 8.29 | 8.35 | 8.32 | 8.01 | |
| UniWorld-V2Source Category=open-source2026.06 | 7.08 | 8.53 | 6.78 | 6.73 | 6.45 | 6.6 | 7.43 | 6.99 | 7.44 | 7.43 | 7.41 | 7.46 | 6.46 | 6.64 | |
| Step1X-EditSource Category=open-source2026.06 | 6.79 | 9.24 | 5.93 | 6.19 | 6.87 | 3.16 | 7.2 | 6.77 | 7.13 | 7.16 | 7.44 | 7.16 | 6.02 | 6.15 | |
| Qwen-Image-EditSource Category=open-source2026.06 | 6.71 | 8.41 | 6.35 | 6.37 | 5.79 | 6.41 | 7.38 | 6.1 | 7.33 | 7.01 | 7.09 | 6.83 | 6.36 | 6.27 | |
| Gemini-2.5Source Category=closed-source2026.06 | 6.51 | 7.21 | 6.13 | 6.64 | 5.72 | 7.36 | 6.79 | 5.87 | 6.07 | 6.55 | 6.52 | 6.43 | 6.68 | 6.37 | |
| BAGEL-ThinkSource Category=open-source2026.06 | 6.43 | 8.53 | 5.72 | 5.96 | 6.26 | 5.77 | 6.82 | 6.55 | 6.59 | 6.53 | 7.08 | 7.01 | 5.83 | 5.72 | |
| PhyWorldSource Category=video-based2026.06 | 6.43 | 7.58 | 5.89 | 6.3 | 6.26 | 6.29 | 6.55 | 6.1 | 6.94 | 6.59 | 6.59 | 6.34 | 6.27 | 6.36 | |
| BAGELSource Category=open-source2026.06 | 6.09 | 7.82 | 5.47 | 5.69 | 6.04 | 5.55 | 6.43 | 6.21 | 6.14 | 6.01 | 7.06 | 6.87 | 5.49 | 4.99 | |
| InstructPix2PixSource Category=open-source2026.06 | 5.61 | 7.08 | 4.16 | 5.58 | 7.12 | 4.24 | 6.41 | 5.49 | 6.67 | 5.51 | 6.23 | 5.97 | 4.98 | 5.36 | |
| Frame2FrameSource Category=video-based2026.06 | 5.38 | 7.96 | 4.08 | 4.73 | 6.65 | 5.25 | 5.43 | 5.17 | 5.86 | 5.62 | 6.04 | 5.7 | 4.35 | 5.17 | |
| OmniGen2Source Category=open-source2026.06 | 5.36 | 6.35 | 4.23 | 5.54 | 5.96 | 3.71 | 6.32 | 5.51 | 6.05 | 5.44 | 5.4 | 5.3 | 5.54 | 5.08 | |
| FLUX.1-Kontext-devSource Category=open-source2026.06 | 5.27 | 7.03 | 4.56 | 4.81 | 5.71 | 5.4 | 5.37 | 4.99 | 5.44 | 5.53 | 5.51 | 5.36 | 5.02 | 4.94 |