# Instruction-based Image Editing on SmartEdit Understanding

Source: [Instruction-based Image Editing on SmartEdit Understanding](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-understanding>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-09T07:19:27.160Z

Evaluation of model performance on Instruction-based Image Editing using quantitative metrics including PSNR, SSIM, LPIPS, CLIP score, and SUCC on the SmartEdit Understanding dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Instruction-based Image Editing |
| Dataset (including any stated split) | SmartEdit Understanding |
| Metric | PSNR |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [PSNR](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-understanding.md?metric=PSNR>): Higher is better; unit: SCALAR.

- [SSIM](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-understanding.md?metric=SSIM>): Higher is better; unit: SCALAR.

- [LPIPS](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-understanding.md?metric=LPIPS>): Lower is better; unit: SCALAR.

- [CLIP Score](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-understanding.md?metric=CLIP%20Score>): Higher is better; unit: SCALAR.

- [SUCC](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-understanding.md?metric=SUCC>): Higher is better; unit: PERCENT.

## Recorded results

| Method | PSNR | Result date | Report paper |
| --- | --- | --- | --- |
| COEDITOR++ | 35.89 | Not recorded | 69ae53f42d603e6de3e429d5 |
| COEDITOR++ | 35.644 | Not recorded | 69ae53f42d603e6de3e429d5 |
| INSIGHT-EDIT | 24.503 | Not recorded | 69ae53f42d603e6de3e429d5 |
| NANO BANANA PRO | 23.678 | Not recorded | 69ae53f42d603e6de3e429d5 |
| NANO BANANA | 23.083 | Not recorded | 69ae53f42d603e6de3e429d5 |
| OMNIGEN | 22.931 | Not recorded | 69ae53f42d603e6de3e429d5 |
| SMARTEDIT-13B | 22.801 | Not recorded | 69ae53f42d603e6de3e429d5 |
| SEED-X | 19.642 | Not recorded | 69ae53f42d603e6de3e429d5 |
| ICEDIT | 19.556 | Not recorded | 69ae53f42d603e6de3e429d5 |
| QWEN-IMAGE-EDIT | 19.414 | Not recorded | 69ae53f42d603e6de3e429d5 |
| INSTRUCTDIFFUSION | 16.486 | Not recorded | 69ae53f42d603e6de3e429d5 |
| INSTRUCTPIX2PIX | 16.187 | Not recorded | 69ae53f42d603e6de3e429d5 |
| MAGICBRUSH | 16.182 | Not recorded | 69ae53f42d603e6de3e429d5 |
| GPT-4O | 15.303 | Not recorded | 69ae53f42d603e6de3e429d5 |

### COEDITOR++

PSNR: 35.89. Result ID: 69ae73c56dbb7075b9561fba.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

Recorded evaluation configuration: {"Reflective Self-Selection":"True"}. This record does not assert independent reproduction.

### COEDITOR++

PSNR: 35.644. Result ID: 69ae73c56dbb7075b9561fb9.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

Recorded evaluation configuration: {"Reflective Self-Selection":"False"}. This record does not assert independent reproduction.

### INSIGHT-EDIT

PSNR: 24.503. Result ID: 69ae73c56dbb7075b9561fb6.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e41e209131cea6a7d9.md>)

[Implementation](<https://poppyxu.github.io/InsightEdit_web/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### NANO BANANA PRO

PSNR: 23.678. Result ID: 69ae73c56dbb7075b9561faf.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### NANO BANANA

PSNR: 23.083. Result ID: 69ae73c56dbb7075b9561fae.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OMNIGEN

PSNR: 22.931. Result ID: 69ae73c56dbb7075b9561fb5.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d81e209131cea6a322.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SMARTEDIT-13B

PSNR: 22.801. Result ID: 69ae73c56dbb7075b9561fb3.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa717b1e209131cea51882.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SEED-X

PSNR: 19.642. Result ID: 69ae73c56dbb7075b9561fb4.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773d1e209131cea71e9c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ICEDIT

PSNR: 19.556. Result ID: 69ae73c56dbb7075b9561fb7.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b8a1e209131cea89042.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### QWEN-IMAGE-EDIT

PSNR: 19.414. Result ID: 69ae73c56dbb7075b9561fb8.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a6a1e209131cea83137.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### INSTRUCTDIFFUSION

PSNR: 16.486. Result ID: 69ae73c56dbb7075b9561fb2.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70911e209131cea4bdb8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### INSTRUCTPIX2PIX

PSNR: 16.187. Result ID: 69ae73c56dbb7075b9561fb0.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e641e209131cea3fa43.md>)

[Implementation](<https://www.sota2.com/timothybrooks.com/instruct-pix2pix>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MAGICBRUSH

PSNR: 16.182. Result ID: 69ae73c56dbb7075b9561fb1.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa732e1e209131cea5af49.md>)

[Implementation](<https://osu-nlp-group.github.io/MagicBrush>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-4O

PSNR: 15.303. Result ID: 69ae73c56dbb7075b9561fad.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75681e209131cea67a98.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
