# Image Editing on PIE Bench (Including Efficiency Metrics)

Source: [Image Editing on PIE Bench (Including Efficiency Metrics)](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-31T11:49:39.899Z

Evaluation of image editing performance on the PIE Bench dataset, reporting perceptual quality metrics (e.g., PSNR, LPIPS, CLIP Semantics) alongside inference efficiency metrics (Runtime, VRAM usage, NFE).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Editing |
| Dataset (including any stated split) | PIE Bench |
| Metric | PSNR |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 32 of 32 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [PSNR](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=PSNR>): Higher is better; unit: SCALAR.

- [Distance 103](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=Distance%20103>): Lower is better; unit: SCALAR.

- [MSE 103](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=MSE%20103>): Lower is better; unit: SCALAR.

- [SSIM 102](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=SSIM%20102>): Higher is better; unit: PERCENT.

- [LPIPS 103](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=LPIPS%20103>): Lower is better; unit: SCALAR.

- [CLIP Semantics (Whole)](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=CLIP%20Semantics%20(Whole)>): Higher is better; unit: SCALAR.

- [CLIP Semantics (Edited)](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=CLIP%20Semantics%20(Edited)>): Higher is better; unit: SCALAR.

- [Runtime (s)](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=Runtime%20(s)>): Lower is better; unit: TIME.

- [Step Count](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=Step%20Count>): Higher is better; unit: SCALAR.

- [NFE](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=NFE>): Lower is better; unit: SCALAR.

- [VRAM (MiB)](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=VRAM%20(MiB)>): Lower is better; unit: SIZE.

- [LPIPS (x10^3)](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=LPIPS%20(x10%5E3)>): Lower is better; unit: SCALAR.

- [MSE (x10^4)](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=MSE%20(x10%5E4)>): Lower is better; unit: SCALAR.

- [CLIP Score (General)](<https://www.sota2.com/research/sota/image-editing-on-pie-bench-including-efficiency-metrics.md?metric=CLIP%20Score%20(General)>): Higher is better; unit: SCALAR.

## Recorded results

| Method | PSNR | Result date | Report paper |
| --- | --- | --- | --- |
| BiFM | 29.89 | Not recorded | 69c60eee0636e5bf4afc83f1 |
| InstantEdit | 29.63 | Not recorded | 69c60eee0636e5bf4afc83f1 |
| BiFM | 28.92 | Not recorded | 69c60eee0636e5bf4afc83f1 |
| InstantEdit | 27.96 | Not recorded | 69c60eee0636e5bf4afc83f1 |
| EditFT | 26.62 | Not recorded | 69c60eee0636e5bf4afc83f1 |
| InfEdit | 24.14 | Not recorded | 699d30756017c4460ffab33a |
| ChordEdit | 23.89 | Not recorded | 699d30756017c4460ffab33a |
| InstantEdit | 23.8 | Not recorded | 699d30756017c4460ffab33a |
| DNAEdit | 23.24 | Not recorded | 69c60eee0636e5bf4afc83f1 |
| ChordEdit | 23.05 | Not recorded | 699d30756017c4460ffab33a |
| FireFlow | 23.03 | Not recorded | 69c60eee0636e5bf4afc83f1 |
| ChordEdit | 22.2 | Not recorded | 699d30756017c4460ffab33a |
| FlowEdit | 22.17 | Not recorded | 699d30756017c4460ffab33a |
| ChordEdit | 22.05 | Not recorded | 699d30756017c4460ffab33a |
| ChordEdit | 22.04 | Not recorded | 699d30756017c4460ffab33a |
| FlowEdit | 21.96 | Not recorded | 69c60eee0636e5bf4afc83f1 |
| ChordEdit | 21.89 | Not recorded | 699d30756017c4460ffab33a |
| Direct Inversion + MasaCtrl | 21.78 | Not recorded | 699d30756017c4460ffab33a |
| SwiftEdit | 21.71 | Not recorded | 699d30756017c4460ffab33a |
| TurboEdit | 21.44 | Not recorded | 699d30756017c4460ffab33a |
| Direct Inversion + PnP | 21.43 | Not recorded | 699d30756017c4460ffab33a |
| ChordEdit | 21.38 | Not recorded | 699d30756017c4460ffab33a |
| DDIM + PnP | 21.26 | Not recorded | 699d30756017c4460ffab33a |
| DDIM + MasaCtrl | 21.25 | Not recorded | 699d30756017c4460ffab33a |
| ChordEdit | 20.52 | Not recorded | 699d30756017c4460ffab33a |

### BiFM

PSNR: 29.89. Result ID: 69c678f647f34ce924b04c69.

[Reporting paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

Recorded evaluation configuration: {"Settings":"Multi-Step","Steps":"50"}. This record does not assert independent reproduction.

### InstantEdit

PSNR: 29.63. Result ID: 69c678f647f34ce924b04c6b.

[Reporting paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a871e209131cea83b6f.md>)

Recorded evaluation configuration: {"Settings":"Few-Step","Steps":"12"}. This record does not assert independent reproduction.

### BiFM

PSNR: 28.92. Result ID: 69c678f647f34ce924b04c6d.

[Reporting paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

Recorded evaluation configuration: {"Settings":"Few-Step","Steps":"4"}. This record does not assert independent reproduction.

### InstantEdit

PSNR: 27.96. Result ID: 69c678f647f34ce924b04c6c.

[Reporting paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a871e209131cea83b6f.md>)

Recorded evaluation configuration: {"Settings":"Few-Step","Steps":"4"}. This record does not assert independent reproduction.

### EditFT

PSNR: 26.62. Result ID: 69c678f647f34ce924b04c68.

[Reporting paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77931e209131cea740d2.md>)

[Implementation](<https://pengchengpcx.github.io/EditFT/>)

Recorded evaluation configuration: {"Settings":"Multi-Step","Steps":"30"}. This record does not assert independent reproduction.

### InfEdit

PSNR: 24.14. Result ID: 699e37145698665ec4f37108.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71601e209131cea50f04.md>)

[Implementation](<https://sled-group.github.io/InfEdit/>)

Recorded evaluation configuration: {"Type":"Few-step (4 steps)","Base Model":"SD1.4"}. This record does not assert independent reproduction.

### ChordEdit

PSNR: 23.89. Result ID: 699e37145698665ec4f37112.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

Recorded evaluation configuration: {"Type":"One-step","Variant":"Ours w/o prox","Base Model":"SD-Turbo"}. This record does not assert independent reproduction.

### InstantEdit

PSNR: 23.8. Result ID: 699e37145698665ec4f37109.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a871e209131cea83b6f.md>)

Recorded evaluation configuration: {"Type":"Few-step (4 steps)","Base Model":"PeRFlow-SD1.5"}. This record does not assert independent reproduction.

### DNAEdit

PSNR: 23.24. Result ID: 69c678f647f34ce924b04c66.

[Reporting paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79011e209131cea7b9bd.md>)

Recorded evaluation configuration: {"Settings":"Multi-Step","Steps":"28"}. This record does not assert independent reproduction.

### ChordEdit

PSNR: 23.05. Result ID: 699e37145698665ec4f3710c.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

Recorded evaluation configuration: {"Type":"One-step","Variant":"Our","Base Model":"InstaFlow"}. This record does not assert independent reproduction.

### FireFlow

PSNR: 23.03. Result ID: 69c678f647f34ce924b04c6a.

[Reporting paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa762c1e209131cea6bacf.md>)

Recorded evaluation configuration: {"Settings":"Few-Step","Steps":"18"}. This record does not assert independent reproduction.

### ChordEdit

PSNR: 22.2. Result ID: 699e37145698665ec4f37111.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

Recorded evaluation configuration: {"Type":"One-step","Variant":"Ours","Base Model":"SD-Turbo"}. This record does not assert independent reproduction.

### FlowEdit

PSNR: 22.17. Result ID: 699e37145698665ec4f37106.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a2c1e209131cea818b2.md>)

Recorded evaluation configuration: {"Type":"Multi-step (\>= 20 steps)","Base Model":"SD3"}. This record does not assert independent reproduction.

### ChordEdit

PSNR: 22.05. Result ID: 699e37145698665ec4f3710b.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

Recorded evaluation configuration: {"Type":"One-step","Variant":"Naive","Base Model":"InstaFlow"}. This record does not assert independent reproduction.

### ChordEdit

PSNR: 22.04. Result ID: 699e37145698665ec4f3710e.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

Recorded evaluation configuration: {"Type":"One-step","Variant":"Our","Base Model":"SwiftBrush-v2"}. This record does not assert independent reproduction.

### FlowEdit

PSNR: 21.96. Result ID: 69c678f647f34ce924b04c67.

[Reporting paper](<https://www.sota2.com/research/paper/69c60eee0636e5bf4afc83f1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a2c1e209131cea818b2.md>)

Recorded evaluation configuration: {"Settings":"Multi-Step","Steps":"28"}. This record does not assert independent reproduction.

### ChordEdit

PSNR: 21.89. Result ID: 699e37145698665ec4f37110.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

Recorded evaluation configuration: {"Type":"One-step","Variant":"Naive w/o prox","Base Model":"SD-Turbo"}. This record does not assert independent reproduction.

### Direct Inversion + MasaCtrl

PSNR: 21.78. Result ID: 699e37145698665ec4f37103.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f161e209131cea43d42.md>)

Recorded evaluation configuration: {"Type":"Multi-step (\>= 20 steps)"}. This record does not assert independent reproduction.

### SwiftEdit

PSNR: 21.71. Result ID: 699e37145698665ec4f3710a.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79071e209131cea7bc79.md>)

[Implementation](<https://swift-edit.github.io/>)

Recorded evaluation configuration: {"Type":"One-step","Base Model":"SwiftBrush-v2"}. This record does not assert independent reproduction.

### TurboEdit

PSNR: 21.44. Result ID: 699e37145698665ec4f37107.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa744f1e209131cea60f7e.md>)

Recorded evaluation configuration: {"Type":"Few-step (4 steps)","Base Model":"SDXL-Turbo"}. This record does not assert independent reproduction.

### Direct Inversion + PnP

PSNR: 21.43. Result ID: 699e37145698665ec4f37105.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dfe1e209131cea3d3e5.md>)

[Implementation](<https://pnp-diffusion.github.io/>)

Recorded evaluation configuration: {"Type":"Multi-step (\>= 20 steps)"}. This record does not assert independent reproduction.

### ChordEdit

PSNR: 21.38. Result ID: 699e37145698665ec4f3710f.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

Recorded evaluation configuration: {"Type":"One-step","Variant":"Naive","Base Model":"SD-Turbo"}. This record does not assert independent reproduction.

### DDIM + PnP

PSNR: 21.26. Result ID: 699e37145698665ec4f37104.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dfe1e209131cea3d3e5.md>)

[Implementation](<https://pnp-diffusion.github.io/>)

Recorded evaluation configuration: {"Type":"Multi-step (\>= 20 steps)"}. This record does not assert independent reproduction.

### DDIM + MasaCtrl

PSNR: 21.25. Result ID: 699e37145698665ec4f37102.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f161e209131cea43d42.md>)

Recorded evaluation configuration: {"Type":"Multi-step (\>= 20 steps)"}. This record does not assert independent reproduction.

### ChordEdit

PSNR: 20.52. Result ID: 699e37145698665ec4f3710d.

[Reporting paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30756017c4460ffab33a.md>)

Recorded evaluation configuration: {"Type":"One-step","Variant":"Naive","Base Model":"SwiftBrush-v2"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.