# Subjective Image Quality Assessment on User Study (test)

Source: [Subjective Image Quality Assessment on User Study (test)](<https://www.sota2.com/research/sota/subjective-image-quality-assessment-on-user-study-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:35:35.069Z

Evaluation of subjective image quality assessment based on a user study, where results are reported based on the percentage of times a model's output achieved Rank 1, Rank 2, or Rank 3 preference.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Subjective Image Quality Assessment |
| Dataset (including any stated split) | User Study (test) |
| Metric | Average Rank |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Average Rank](<https://www.sota2.com/research/sota/subjective-image-quality-assessment-on-user-study-test.md?metric=Average%20Rank>): Lower is better; unit: SCALAR.

- [Rank 1 Preference](<https://www.sota2.com/research/sota/subjective-image-quality-assessment-on-user-study-test.md?metric=Rank%201%20Preference>): Higher is better; unit: PERCENT.

- [Rank 2 Preference](<https://www.sota2.com/research/sota/subjective-image-quality-assessment-on-user-study-test.md?metric=Rank%202%20Preference>): Higher is better; unit: PERCENT.

- [Rank 3 Preference](<https://www.sota2.com/research/sota/subjective-image-quality-assessment-on-user-study-test.md?metric=Rank%203%20Preference>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Average Rank | Result date | Report paper |
| --- | --- | --- | --- |
| Diff-Plugin | 1.17 | Not recorded | 68fa73601e209131cea5c027 |
| WGWS-Net | 2.75 | Not recorded | 68fa73601e209131cea5c027 |
| PromptIR | 3.04 | Not recorded | 68fa73601e209131cea5c027 |
| ControlNet | 4.33 | Not recorded | 68fa73601e209131cea5c027 |
| AirNet | 5.26 | Not recorded | 68fa73601e209131cea5c027 |
| P2P | 6.32 | Not recorded | 68fa73601e209131cea5c027 |
| InstructP2P | 7.14 | Not recorded | 68fa73601e209131cea5c027 |
| PNP | 7.39 | Not recorded | 68fa73601e209131cea5c027 |
| Null-Text | 7.94 | Not recorded | 68fa73601e209131cea5c027 |
| SD | 9.66 | Not recorded | 68fa73601e209131cea5c027 |

### Diff-Plugin

Average Rank: 1.17. Result ID: 6992d52c3a6c31484911cec5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

[Implementation](<https://yuhaoliu7456.github.io/Diff-Plugin>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### WGWS-Net

Average Rank: 2.75. Result ID: 6992d52c3a6c31484911cebd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PromptIR

Average Rank: 3.04. Result ID: 6992d52c3a6c31484911cebe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fe31e209131cea47ee5.md>)

[Implementation](<https://github.com/va1shn9v/PromptIR>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ControlNet

Average Rank: 4.33. Result ID: 6992d52c3a6c31484911cec4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71481e209131cea50695.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AirNet

Average Rank: 5.26. Result ID: 6992d52c3a6c31484911cebc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### P2P

Average Rank: 6.32. Result ID: 6992d52c3a6c31484911cec1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e801e209131cea405f6.md>)

[Implementation](<https://pix2pixzero.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### InstructP2P

Average Rank: 7.14. Result ID: 6992d52c3a6c31484911cec2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e641e209131cea3fa43.md>)

[Implementation](<https://www.sota2.com/timothybrooks.com/instruct-pix2pix>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PNP

Average Rank: 7.39. Result ID: 6992d52c3a6c31484911cec0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f781e209131cea45cf2.md>)

[Implementation](<https://github.com/thunlp/Document-Plugin>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Null-Text

Average Rank: 7.94. Result ID: 6992d52c3a6c31484911cec3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e011e209131cea3d583.md>)

[Implementation](<https://null-text-inversion.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SD

Average Rank: 9.66. Result ID: 6992d52c3a6c31484911cebf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c027.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c391e209131cea32e4a.md>)

[Implementation](<https://github.com/CompVis/latent-diffusion>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.