# Instruction-based Image Editing on SmartEdit Reasoning

Source: [Instruction-based Image Editing on SmartEdit Reasoning](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-reasoning>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-09T07:19:27.198Z

Evaluation of model performance on instruction-based image editing tasks using metrics including PSNR, SSIM, LPIPS, CLIP Score, and SUCC on the SmartEdit Reasoning dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Instruction-based Image Editing |
| Dataset (including any stated split) | SmartEdit Reasoning |
| Metric | PSNR |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [PSNR](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-reasoning.md?metric=PSNR>): Higher is better; unit: SCALAR.

- [SSIM](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-reasoning.md?metric=SSIM>): Higher is better; unit: PERCENT.

- [LPIPS](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-reasoning.md?metric=LPIPS>): Lower is better; unit: SCALAR.

- [CLIP Score](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-reasoning.md?metric=CLIP%20Score>): Higher is better; unit: SCALAR.

- [SUCC](<https://www.sota2.com/research/sota/instruction-based-image-editing-on-smartedit-reasoning.md?metric=SUCC>): Higher is better; unit: PERCENT.

## Recorded results

| Method | PSNR | Result date | Report paper |
| --- | --- | --- | --- |
| COEDITOR++ | 41.061 | Not recorded | 69ae53f42d603e6de3e429d5 |
| COEDITOR++ | 40.36 | Not recorded | 69ae53f42d603e6de3e429d5 |
| NANO BANANA PRO | 26.408 | Not recorded | 69ae53f42d603e6de3e429d5 |
| INSIGHT-EDIT | 26.09 | Not recorded | 69ae53f42d603e6de3e429d5 |
| SMARTEDIT-13B | 25.327 | Not recorded | 69ae53f42d603e6de3e429d5 |
| QWEN-IMAGE-EDIT | 24.597 | Not recorded | 69ae53f42d603e6de3e429d5 |
| OMNIGEN | 24.585 | Not recorded | 69ae53f42d603e6de3e429d5 |
| NANO BANANA | 22.665 | Not recorded | 69ae53f42d603e6de3e429d5 |
| MAGICBRUSH | 22.661 | Not recorded | 69ae53f42d603e6de3e429d5 |
| ICEDIT | 22.346 | Not recorded | 69ae53f42d603e6de3e429d5 |
| INSTRUCTPIX2PIX | 20.856 | Not recorded | 69ae53f42d603e6de3e429d5 |
| SEED-X | 20.767 | Not recorded | 69ae53f42d603e6de3e429d5 |
| INSTRUCTDIFFUSION | 18.463 | Not recorded | 69ae53f42d603e6de3e429d5 |
| GPT-4O | 15.125 | Not recorded | 69ae53f42d603e6de3e429d5 |

### COEDITOR++

PSNR: 41.061. Result ID: 69ae73c56dbb7075b9561fc8.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

Recorded evaluation configuration: {"Reflective Self-Selection":"True"}. This record does not assert independent reproduction.

### COEDITOR++

PSNR: 40.36. Result ID: 69ae73c56dbb7075b9561fc7.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

Recorded evaluation configuration: {"Reflective Self-Selection":"False"}. This record does not assert independent reproduction.

### NANO BANANA PRO

PSNR: 26.408. Result ID: 69ae73c56dbb7075b9561fbd.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### INSIGHT-EDIT

PSNR: 26.09. Result ID: 69ae73c56dbb7075b9561fc4.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e41e209131cea6a7d9.md>)

[Implementation](<https://poppyxu.github.io/InsightEdit_web/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SMARTEDIT-13B

PSNR: 25.327. Result ID: 69ae73c56dbb7075b9561fc1.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa717b1e209131cea51882.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### QWEN-IMAGE-EDIT

PSNR: 24.597. Result ID: 69ae73c56dbb7075b9561fc6.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a6a1e209131cea83137.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OMNIGEN

PSNR: 24.585. Result ID: 69ae73c56dbb7075b9561fc3.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d81e209131cea6a322.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### NANO BANANA

PSNR: 22.665. Result ID: 69ae73c56dbb7075b9561fbc.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MAGICBRUSH

PSNR: 22.661. Result ID: 69ae73c56dbb7075b9561fbf.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa732e1e209131cea5af49.md>)

[Implementation](<https://osu-nlp-group.github.io/MagicBrush>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ICEDIT

PSNR: 22.346. Result ID: 69ae73c56dbb7075b9561fc5.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b8a1e209131cea89042.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### INSTRUCTPIX2PIX

PSNR: 20.856. Result ID: 69ae73c56dbb7075b9561fbe.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e641e209131cea3fa43.md>)

[Implementation](<https://www.sota2.com/timothybrooks.com/instruct-pix2pix>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SEED-X

PSNR: 20.767. Result ID: 69ae73c56dbb7075b9561fc2.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773d1e209131cea71e9c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### INSTRUCTDIFFUSION

PSNR: 18.463. Result ID: 69ae73c56dbb7075b9561fc0.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70911e209131cea4bdb8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-4O

PSNR: 15.125. Result ID: 69ae73c56dbb7075b9561fbb.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53f42d603e6de3e429d5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75681e209131cea67a98.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
