# Image Editing on IMBA 1.0 (test)

Source: [Image Editing on IMBA 1.0 (test)](<https://www.sota2.com/research/sota/image-editing-on-imba-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-14T08:13:50.607Z

Evaluation of Image Editing performance on the IMBA 1.0 test split, using metrics focused on object retention, background retention, realism, and user satisfaction.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Editing |
| Dataset (including any stated split) | IMBA 1.0 (test) |
| Metric | Object Retention Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Object Retention Score](<https://www.sota2.com/research/sota/image-editing-on-imba-1-0-test.md?metric=Object%20Retention%20Score>): Higher is better; unit: SCALAR.

- [Background Retention Score](<https://www.sota2.com/research/sota/image-editing-on-imba-1-0-test.md?metric=Background%20Retention%20Score>): Higher is better; unit: SCALAR.

- [Realism Score](<https://www.sota2.com/research/sota/image-editing-on-imba-1-0-test.md?metric=Realism%20Score>): Higher is better; unit: SCALAR.

- [User Satisfaction Score](<https://www.sota2.com/research/sota/image-editing-on-imba-1-0-test.md?metric=User%20Satisfaction%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Object Retention Score | Result date | Report paper |
| --- | --- | --- | --- |
| CPAM-SD1.5 | 4.72 | Not recorded | 68fa798f1e209131cea7e3d4 |
| PnP | 4.61 | Not recorded | 68fa798f1e209131cea7e3d4 |
| DiffEdit | 4.58 | Not recorded | 68fa798f1e209131cea7e3d4 |
| FPE | 4.5 | Not recorded | 68fa798f1e209131cea7e3d4 |
| LEDIT++ | 4.38 | Not recorded | 68fa798f1e209131cea7e3d4 |
| MasaCtrl | 4.01 | Not recorded | 68fa798f1e209131cea7e3d4 |
| Imagic | 3.74 | Not recorded | 68fa798f1e209131cea7e3d4 |
| SDEdit | 3.63 | Not recorded | 68fa798f1e209131cea7e3d4 |
| Pix2Pix-Zero | 2.11 | Not recorded | 68fa798f1e209131cea7e3d4 |

### CPAM-SD1.5

Object Retention Score: 4.72. Result ID: 69ddf73b47f34ce924c54c66.

[Reporting paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

Recorded evaluation configuration: {"Backbone Checkpoint":"SD-1.5"}. This record does not assert independent reproduction.

### PnP

Object Retention Score: 4.61. Result ID: 69ddf73b47f34ce924c54c60.

[Reporting paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dfe1e209131cea3d3e5.md>)

[Implementation](<https://pnp-diffusion.github.io/>)

Recorded evaluation configuration: {"Backbone Checkpoint":"SD-1.5"}. This record does not assert independent reproduction.

### DiffEdit

Object Retention Score: 4.58. Result ID: 69ddf73b47f34ce924c54c62.

[Reporting paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bc66.md>)

Recorded evaluation configuration: {"Backbone Checkpoint":"SD-1.5"}. This record does not assert independent reproduction.

### FPE

Object Retention Score: 4.5. Result ID: 69ddf73b47f34ce924c54c61.

[Reporting paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72621e209131cea561c6.md>)

[Implementation](<https://github.com/alibaba/EasyNLP/tree/master/diffusion/FreePromptEditing>)

Recorded evaluation configuration: {"Backbone Checkpoint":"SD-1.5"}. This record does not assert independent reproduction.

### LEDIT++

Object Retention Score: 4.38. Result ID: 69ddf73b47f34ce924c54c64.

[Reporting paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73e31e209131cea5eb33.md>)

Recorded evaluation configuration: {"Backbone Checkpoint":"SD-1.5"}. This record does not assert independent reproduction.

### MasaCtrl

Object Retention Score: 4.01. Result ID: 69ddf73b47f34ce924c54c5f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f161e209131cea43d42.md>)

Recorded evaluation configuration: {"Backbone Checkpoint":"SD-1.5"}. This record does not assert independent reproduction.

### Imagic

Object Retention Score: 3.74. Result ID: 69ddf73b47f34ce924c54c65.

[Reporting paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ecf1e209131cea424fa.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Fine-tuning","Backbone Checkpoint":"SD-1.5"}. This record does not assert independent reproduction.

### SDEdit

Object Retention Score: 3.63. Result ID: 69ddf73b47f34ce924c54c5e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b831e209131cea2ebbb.md>)

Recorded evaluation configuration: {"Backbone Checkpoint":"SD-1.5"}. This record does not assert independent reproduction.

### Pix2Pix-Zero

Object Retention Score: 2.11. Result ID: 69ddf73b47f34ce924c54c63.

[Reporting paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e3d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e801e209131cea405f6.md>)

[Implementation](<https://pix2pixzero.github.io/>)

Recorded evaluation configuration: {"Backbone Checkpoint":"SD-1.5"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.