# ISP Modification on ISP Modification Data Videos (Holdout Set)

Source: [ISP Modification on ISP Modification Data Videos (Holdout Set)](<https://www.sota2.com/research/sota/isp-modification-on-isp-modification-data-videos-holdout-set>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-06T08:58:51.071Z

Evaluation of Image Signal Processing (ISP) modification performance on the holdout set of the ISP Modification Data Videos, measured using PSNR, SSIM, and LPIPS.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | ISP Modification |
| Dataset (including any stated split) | ISP Modification Data Videos (Holdout Set) |
| Metric | PSNR |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 4 of 4 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [PSNR](<https://www.sota2.com/research/sota/isp-modification-on-isp-modification-data-videos-holdout-set.md?metric=PSNR>): Higher is better; unit: SCALAR.

- [SSIM](<https://www.sota2.com/research/sota/isp-modification-on-isp-modification-data-videos-holdout-set.md?metric=SSIM>): Higher is better; unit: PERCENT.

- [LPIPS](<https://www.sota2.com/research/sota/isp-modification-on-isp-modification-data-videos-holdout-set.md?metric=LPIPS>): Lower is better; unit: SCALAR.

## Recorded results

| Method | PSNR | Result date | Report paper |
| --- | --- | --- | --- |
| DiffusionHarmonizer | 28.1 | Not recorded | 69a5196c2d603e6de3e3c888 |
| SDEdit | 17.46 | Not recorded | 69a5196c2d603e6de3e3c888 |
| InstructPix2Pix | 16.71 | Not recorded | 69a5196c2d603e6de3e3c888 |
| Wan-Video V2V | 15.81 | Not recorded | 69a5196c2d603e6de3e3c888 |

### DiffusionHarmonizer

PSNR: 28.1. Result ID: 69aa96ef6dbb7075b9547b21.

[Reporting paper](<https://www.sota2.com/research/paper/69a5196c2d603e6de3e3c888.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a5196c2d603e6de3e3c888.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SDEdit

PSNR: 17.46. Result ID: 69aa96ef6dbb7075b9547b1e.

[Reporting paper](<https://www.sota2.com/research/paper/69a5196c2d603e6de3e3c888.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b831e209131cea2ebbb.md>)

Recorded evaluation configuration: {"backbone":"SD 3"}. This record does not assert independent reproduction.

### InstructPix2Pix

PSNR: 16.71. Result ID: 69aa96ef6dbb7075b9547b1f.

[Reporting paper](<https://www.sota2.com/research/paper/69a5196c2d603e6de3e3c888.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e641e209131cea3fa43.md>)

[Implementation](<https://www.sota2.com/timothybrooks.com/instruct-pix2pix>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Wan-Video V2V

PSNR: 15.81. Result ID: 69aa96ef6dbb7075b9547b20.

[Reporting paper](<https://www.sota2.com/research/paper/69a5196c2d603e6de3e3c888.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76f7d.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.