# Text-to-Image Preference Evaluation on ImageReward

Source: [Text-to-Image Preference Evaluation on ImageReward](<https://www.sota2.com/research/sota/text-to-image-preference-evaluation-on-imagereward>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-18T08:43:23.924Z

Evaluation of text-to-image generation models using the ImageReward dataset, measured by the ImageReward score to assess human preference alignment.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Text-to-Image Preference Evaluation |
| Dataset (including any stated split) | ImageReward |
| Metric | ImageReward Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ImageReward Score](<https://www.sota2.com/research/sota/text-to-image-preference-evaluation-on-imagereward.md?metric=ImageReward%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | ImageReward Score | Result date | Report paper |
| --- | --- | --- | --- |
| DRL | -0.309 | Not recorded | 6a337bd1206542251d7c525d |
| DRL | -0.415 | Not recorded | 6a337bd1206542251d7c525d |
| DRL | -0.486 | Not recorded | 6a337bd1206542251d7c525d |
| DRL | -0.488 | Not recorded | 6a337bd1206542251d7c525d |
| DRL | -0.551 | Not recorded | 6a337bd1206542251d7c525d |
| DRL | -0.562 | Not recorded | 6a337bd1206542251d7c525d |
| RAE DiTDH-XL | -0.583 | Not recorded | 6a337bd1206542251d7c525d |
| SiT-XL/2 | -0.584 | Not recorded | 6a337bd1206542251d7c525d |
| REPA SiT-XL/2 | -0.622 | Not recorded | 6a337bd1206542251d7c525d |
| JiT-H/16 | -0.723 | Not recorded | 6a337bd1206542251d7c525d |
| DRL | -0.764 | Not recorded | 6a337bd1206542251d7c525d |
| DRL | -0.804 | Not recorded | 6a337bd1206542251d7c525d |
| RAE DiTDH-XL | -0.933 | Not recorded | 6a337bd1206542251d7c525d |
| JiT-H/16 | -1.159 | Not recorded | 6a337bd1206542251d7c525d |
| REPA SiT-XL/2 | -1.187 | Not recorded | 6a337bd1206542251d7c525d |
| SiT-XL/2 | -1.252 | Not recorded | 6a337bd1206542251d7c525d |

### DRL

ImageReward Score: -0.309. Result ID: 6a33af9dfbc373592c311493.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

Recorded evaluation configuration: {"Backbone":"SiT-XL/2","Guidance":"Guidance","lambda":"10"}. This record does not assert independent reproduction.

### DRL

ImageReward Score: -0.415. Result ID: 6a33af9dfbc373592c311497.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

Recorded evaluation configuration: {"Backbone":"REPA SiT-XL/2","Guidance":"Guidance","lambda":"10"}. This record does not assert independent reproduction.

### DRL

ImageReward Score: -0.486. Result ID: 6a33af9dfbc373592c311491.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

Recorded evaluation configuration: {"Backbone":"SiT-XL/2","Guidance":"No guidance","lambda":"10"}. This record does not assert independent reproduction.

### DRL

ImageReward Score: -0.488. Result ID: 6a33af9dfbc373592c31149f.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

Recorded evaluation configuration: {"Backbone":"RAE DiTDH-XL","Guidance":"Guidance","lambda":"10"}. This record does not assert independent reproduction.

### DRL

ImageReward Score: -0.551. Result ID: 6a33af9dfbc373592c31149b.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

Recorded evaluation configuration: {"Backbone":"JiT-H/16","Guidance":"Guidance","lambda":"10"}. This record does not assert independent reproduction.

### DRL

ImageReward Score: -0.562. Result ID: 6a33af9dfbc373592c311495.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

Recorded evaluation configuration: {"Backbone":"REPA SiT-XL/2","Guidance":"No guidance","lambda":"10"}. This record does not assert independent reproduction.

### RAE DiTDH-XL

ImageReward Score: -0.583. Result ID: 6a33af9dfbc373592c31149e.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c221e209131cea8c9d0.md>)

Recorded evaluation configuration: {"Guidance":"Guidance"}. This record does not assert independent reproduction.

### SiT-XL/2

ImageReward Score: -0.584. Result ID: 6a33af9dfbc373592c311492.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e71e209131cea64974.md>)

Recorded evaluation configuration: {"Guidance":"Guidance"}. This record does not assert independent reproduction.

### REPA SiT-XL/2

ImageReward Score: -0.622. Result ID: 6a33af9dfbc373592c311496.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa797b1e209131cea7dbbf.md>)

[Implementation](<https://sihyun.me/REPA>)

Recorded evaluation configuration: {"Guidance":"Guidance"}. This record does not assert independent reproduction.

### JiT-H/16

ImageReward Score: -0.723. Result ID: 6a33af9dfbc373592c31149a.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/691bfe976750be83fe5cf517.md>)

[Implementation](<https://github.com/LTH14/JiT>)

Recorded evaluation configuration: {"Guidance":"Guidance"}. This record does not assert independent reproduction.

### DRL

ImageReward Score: -0.764. Result ID: 6a33af9dfbc373592c31149d.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

Recorded evaluation configuration: {"Backbone":"RAE DiTDH-XL","Guidance":"No guidance","lambda":"10"}. This record does not assert independent reproduction.

### DRL

ImageReward Score: -0.804. Result ID: 6a33af9dfbc373592c311499.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

Recorded evaluation configuration: {"Backbone":"JiT-H/16","Guidance":"No guidance","lambda":"10"}. This record does not assert independent reproduction.

### RAE DiTDH-XL

ImageReward Score: -0.933. Result ID: 6a33af9dfbc373592c31149c.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c221e209131cea8c9d0.md>)

Recorded evaluation configuration: {"Guidance":"No guidance"}. This record does not assert independent reproduction.

### JiT-H/16

ImageReward Score: -1.159. Result ID: 6a33af9dfbc373592c311498.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/691bfe976750be83fe5cf517.md>)

[Implementation](<https://github.com/LTH14/JiT>)

Recorded evaluation configuration: {"Guidance":"No guidance"}. This record does not assert independent reproduction.

### REPA SiT-XL/2

ImageReward Score: -1.187. Result ID: 6a33af9dfbc373592c311494.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa797b1e209131cea7dbbf.md>)

[Implementation](<https://sihyun.me/REPA>)

Recorded evaluation configuration: {"Guidance":"No guidance"}. This record does not assert independent reproduction.

### SiT-XL/2

ImageReward Score: -1.252. Result ID: 6a33af9dfbc373592c311490.

[Reporting paper](<https://www.sota2.com/research/paper/6a337bd1206542251d7c525d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e71e209131cea64974.md>)

Recorded evaluation configuration: {"Guidance":"No guidance"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
