# Image Editing on ImgEdit (Detailed Action Evaluation)

Source: [Image Editing on ImgEdit (Detailed Action Evaluation)](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-26T10:47:15.873Z

Evaluation of Image Editing performance on the ImgEdit dataset, reporting scores across ten specific dimensions: Extract, Adjust, Background, Add, Replace, Remove, Style, Compose, Action, and Overall.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Editing |
| Dataset (including any stated split) | ImgEdit |
| Metric | Overall Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 32 of 32 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Overall Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Overall%20Score>): Higher is better; unit: SCALAR.

- [Extract Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Extract%20Score>): Higher is better; unit: SCALAR.

- [Adjust Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Adjust%20Score>): Higher is better; unit: SCALAR.

- [Background Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Background%20Score>): Higher is better; unit: SCALAR.

- [Add Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Add%20Score>): Higher is better; unit: SCALAR.

- [Replace Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Replace%20Score>): Higher is better; unit: SCALAR.

- [Remove Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Remove%20Score>): Higher is better; unit: SCALAR.

- [Style Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Style%20Score>): Higher is better; unit: SCALAR.

- [Compose Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Compose%20Score>): Higher is better; unit: SCALAR.

- [Action Score](<https://www.sota2.com/research/sota/image-editing-on-imgedit-detailed-action-evaluation.md?metric=Action%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Overall Score | Result date | Report paper |
| --- | --- | --- | --- |
| UniWorld-Qwen-Image-Edit | 4.48 | Not recorded | 69b39a360636e5bf4afbcced |
| FIRM-Qwen-Edit | 4.42 | Not recorded | 69b39a360636e5bf4afbcced |
| Qwen-Image-Edit-2509 | 4.36 | Not recorded | 69b39a360636e5bf4afbcced |
| Qwen-Image-Edit-2509 | 4.35 | Not recorded | 69b39a360636e5bf4afbcced |
| Qwen-Image-Edit-2509 | 4.28 | Not recorded | 69b39a360636e5bf4afbcced |
| GPT-Image | 4.2 | Not recorded | 69b39a360636e5bf4afbcced |
| GPT-4o | 4.2 | Not recorded | 6a152964dbd7150506f7e30d |
| UniWorld-FLUX.1-Kontext | 4.02 | Not recorded | 69b39a360636e5bf4afbcced |
| FLUX.1-Kontext\[Pro\] | 4 | Not recorded | 69b39a360636e5bf4afbcced |
| BAGEL+UNO | 3.85 | Not recorded | 69fd6e3f5497b3b670c8959f |
| FLUX.1-Kontext\[Dev\] | 3.71 | Not recorded | 69b39a360636e5bf4afbcced |
| FLUX-Kontext | 3.6 | Not recorded | 69fd6e3f5497b3b670c8959f |
| FLUX.1-kontext | 3.48 | Not recorded | 6a152964dbd7150506f7e30d |
| OmniGen2 | 3.44 | Not recorded | 69aa5f722d603e6de3e41830 |
| OmniGen2 | 3.44 | Not recorded | 69b39a360636e5bf4afbcced |
| BAGEL | 3.38 | Not recorded | 69fd6e3f5497b3b670c8959f |
| Nexus-Gen + DIVA | 3.35 | Not recorded | 6a152964dbd7150506f7e30d |
| UniWorld-V1 | 3.26 | Not recorded | 69aa5f722d603e6de3e41830 |
| Janus-4o | 3.26 | Not recorded | 69aa5f722d603e6de3e41830 |
| BAGEL | 3.24 | Not recorded | 6a152964dbd7150506f7e30d |
| BAGEL | 3.2 | Not recorded | 69aa5f722d603e6de3e41830 |
| Step1X-Edit | 3.06 | Not recorded | 69aa5f722d603e6de3e41830 |
| Step1X-Edit | 3.06 | Not recorded | 69b39a360636e5bf4afbcced |
| UltraEdit | 2.99 | Not recorded | 6a152964dbd7150506f7e30d |
| Nexus-Gen | 2.98 | Not recorded | 6a152964dbd7150506f7e30d |
| OmniGen | 2.96 | Not recorded | 69aa5f722d603e6de3e41830 |
| Wallaroo | 2.92 | Not recorded | 69aa5f722d603e6de3e41830 |
| UltraEdit | 2.7 | Not recorded | 69aa5f722d603e6de3e41830 |
| AnyEdit | 2.67 | Not recorded | 6a152964dbd7150506f7e30d |
| AnyEdit | 2.45 | Not recorded | 69aa5f722d603e6de3e41830 |
| AnyEdit | 2.45 | Not recorded | 69b39a360636e5bf4afbcced |
| Instruct-Pix2Pix | 1.88 | Not recorded | 69b39a360636e5bf4afbcced |

### UniWorld-Qwen-Image-Edit

Overall Score: 4.48. Result ID: 69b3da0247f34ce9249e5759.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c6a1e209131cea8df27.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FIRM-Qwen-Edit

Overall Score: 4.42. Result ID: 69b3da0247f34ce9249e575d.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Implementation](<https://github.com/VisionXLab/FIRM-Reward>)

Recorded evaluation configuration: {"RL Reward":"FIRM-Edit-8B"}. This record does not assert independent reproduction.

### Qwen-Image-Edit-2509

Overall Score: 4.36. Result ID: 69b3da0247f34ce9249e575b.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a6a1e209131cea83137.md>)

Recorded evaluation configuration: {"RL Reward":"Qwen3VL-8B"}. This record does not assert independent reproduction.

### Qwen-Image-Edit-2509

Overall Score: 4.35. Result ID: 69b3da0247f34ce9249e575a.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a6a1e209131cea83137.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Qwen-Image-Edit-2509

Overall Score: 4.28. Result ID: 69b3da0247f34ce9249e575c.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a6a1e209131cea83137.md>)

Recorded evaluation configuration: {"RL Reward":"Qwen3VL-32B"}. This record does not assert independent reproduction.

### GPT-Image

Overall Score: 4.2. Result ID: 69b3da0247f34ce9249e5758.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695f39f053fdd5c361743ecb.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-4o

Overall Score: 4.2. Result ID: 6a157a31fbc373592c0da8b5.

[Reporting paper](<https://www.sota2.com/research/paper/6a152964dbd7150506f7e30d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a311e209131cea81aad.md>)

[Implementation](<https://bagel-ai.org/>)

Recorded evaluation configuration: {"# Params":"-"}. This record does not assert independent reproduction.

### UniWorld-FLUX.1-Kontext

Overall Score: 4.02. Result ID: 69b3da0247f34ce9249e5757.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c6a1e209131cea8df27.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FLUX.1-Kontext\[Pro\]

Overall Score: 4. Result ID: 69b3da0247f34ce9249e5756.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79a81e209131cea7eb79.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BAGEL+UNO

Overall Score: 3.85. Result ID: 69fda63c47f34ce924e0cd95.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e3f5497b3b670c8959f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fd6e3f5497b3b670c8959f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FLUX.1-Kontext\[Dev\]

Overall Score: 3.71. Result ID: 69b3da0247f34ce9249e5754.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79a81e209131cea7eb79.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FLUX-Kontext

Overall Score: 3.6. Result ID: 69fda63c47f34ce924e0cd93.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e3f5497b3b670c8959f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79a81e209131cea7eb79.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FLUX.1-kontext

Overall Score: 3.48. Result ID: 6a157a31fbc373592c0da8b8.

[Reporting paper](<https://www.sota2.com/research/paper/6a152964dbd7150506f7e30d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79a81e209131cea7eb79.md>)

Recorded evaluation configuration: {"# Params":"12B"}. This record does not assert independent reproduction.

### OmniGen2

Overall Score: 3.44. Result ID: 69aa8fba6dbb7075b9544c61.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba31e209131cea89864.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OmniGen2

Overall Score: 3.44. Result ID: 69b3da0247f34ce9249e5755.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba31e209131cea89864.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BAGEL

Overall Score: 3.38. Result ID: 69fda63c47f34ce924e0cd94.

[Reporting paper](<https://www.sota2.com/research/paper/69fd6e3f5497b3b670c8959f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a311e209131cea81aad.md>)

[Implementation](<https://bagel-ai.org/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Nexus-Gen + DIVA

Overall Score: 3.35. Result ID: 6a157a32fbc373592c0da8bb.

[Reporting paper](<https://www.sota2.com/research/paper/6a152964dbd7150506f7e30d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a152964dbd7150506f7e30d.md>)

Recorded evaluation configuration: {"# Params":"7B"}. This record does not assert independent reproduction.

### UniWorld-V1

Overall Score: 3.26. Result ID: 69aa8fba6dbb7075b9544c5f.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79831e209131cea7dee8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Janus-4o

Overall Score: 3.26. Result ID: 69aa8fba6dbb7075b9544c60.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BAGEL

Overall Score: 3.24. Result ID: 6a157a32fbc373592c0da8b9.

[Reporting paper](<https://www.sota2.com/research/paper/6a152964dbd7150506f7e30d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a311e209131cea81aad.md>)

[Implementation](<https://bagel-ai.org/>)

Recorded evaluation configuration: {"# Params":"8B+8B"}. This record does not assert independent reproduction.

### BAGEL

Overall Score: 3.2. Result ID: 69aa8fba6dbb7075b9544c5e.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a311e209131cea81aad.md>)

[Implementation](<https://bagel-ai.org/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Step1X-Edit

Overall Score: 3.06. Result ID: 69aa8fba6dbb7075b9544c5d.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Step1X-Edit

Overall Score: 3.06. Result ID: 69b3da0247f34ce9249e5753.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a551e209131cea82892.md>)

[Implementation](<https://github.com/stepfun-ai/Step1X-Edit>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### UltraEdit

Overall Score: 2.99. Result ID: 6a157a31fbc373592c0da8b7.

[Reporting paper](<https://www.sota2.com/research/paper/6a152964dbd7150506f7e30d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76461e209131cea6c155.md>)

[Implementation](<https://www.sota2.com/ultra-editing.github.io>)

Recorded evaluation configuration: {"# Params":"4B"}. This record does not assert independent reproduction.

### Nexus-Gen

Overall Score: 2.98. Result ID: 6a157a32fbc373592c0da8ba.

[Reporting paper](<https://www.sota2.com/research/paper/6a152964dbd7150506f7e30d.md>)

Recorded evaluation configuration: {"# Params":"7B"}. This record does not assert independent reproduction.

### OmniGen

Overall Score: 2.96. Result ID: 69aa8fba6dbb7075b9544c5c.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Wallaroo

Overall Score: 2.92. Result ID: 69aa8fba6dbb7075b9544c62.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### UltraEdit

Overall Score: 2.7. Result ID: 69aa8fba6dbb7075b9544c5b.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AnyEdit

Overall Score: 2.67. Result ID: 6a157a31fbc373592c0da8b6.

[Reporting paper](<https://www.sota2.com/research/paper/6a152964dbd7150506f7e30d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b91e209131cea74f9f.md>)

[Implementation](<https://dcd-anyedit.github.io/>)

Recorded evaluation configuration: {"# Params":"4B"}. This record does not assert independent reproduction.

### AnyEdit

Overall Score: 2.45. Result ID: 69aa8fba6dbb7075b9544c5a.

[Reporting paper](<https://www.sota2.com/research/paper/69aa5f722d603e6de3e41830.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AnyEdit

Overall Score: 2.45. Result ID: 69b3da0247f34ce9249e5752.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b91e209131cea74f9f.md>)

[Implementation](<https://dcd-anyedit.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Instruct-Pix2Pix

Overall Score: 1.88. Result ID: 69b3da0247f34ce9249e5751.

[Reporting paper](<https://www.sota2.com/research/paper/69b39a360636e5bf4afbcced.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e641e209131cea3fa43.md>)

[Implementation](<https://www.sota2.com/timothybrooks.com/instruct-pix2pix>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.