# Reward Modeling on UltraFeedback (Top-50 Regression Metrics)

Source: [Reward Modeling on UltraFeedback (Top-50 Regression Metrics)](<https://www.sota2.com/research/sota/reward-modeling-on-ultrafeedback-top-50-regression-metrics>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-19T07:53:23.946Z

Evaluation of Reward Modeling performance on the UltraFeedback dataset, specifically measuring regression metrics (R2, MSE, MAE) calculated based on the top 50 ranked preferences.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Reward Modeling |
| Dataset (including any stated split) | UltraFeedback |
| Metric | R2 (Top-50) |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [R2 (Top-50)](<https://www.sota2.com/research/sota/reward-modeling-on-ultrafeedback-top-50-regression-metrics.md?metric=R2%20(Top-50)>): Higher is better; unit: SCALAR.

- [MSE (Top-50)](<https://www.sota2.com/research/sota/reward-modeling-on-ultrafeedback-top-50-regression-metrics.md?metric=MSE%20(Top-50)>): Lower is better; unit: SCALAR.

- [MAE (Top-50)](<https://www.sota2.com/research/sota/reward-modeling-on-ultrafeedback-top-50-regression-metrics.md?metric=MAE%20(Top-50)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | R2 (Top-50) | Result date | Report paper |
| --- | --- | --- | --- |
| UARM | 0.794 | Not recorded | 6a34cd3a206542251d7c6056 |
| Clear | 0.77 | Not recorded | 6a34cd3a206542251d7c6056 |
| MCNF | 0.769 | Not recorded | 6a34cd3a206542251d7c6056 |
| SCCP | 0.75 | Not recorded | 6a34cd3a206542251d7c6056 |
| TorchNaut | 0.746 | Not recorded | 6a34cd3a206542251d7c6056 |
| Packed Ensemble | 0.71 | Not recorded | 6a34cd3a206542251d7c6056 |
| ACI | 0.678 | Not recorded | 6a34cd3a206542251d7c6056 |
| DER | 0.663 | Not recorded | 6a34cd3a206542251d7c6056 |
| WCP | 0.646 | Not recorded | 6a34cd3a206542251d7c6056 |
| Deep Ensemble | 0.632 | Not recorded | 6a34cd3a206542251d7c6056 |
| CQR | 0.623 | Not recorded | 6a34cd3a206542251d7c6056 |
| SCP | 0.609 | Not recorded | 6a34cd3a206542251d7c6056 |
| MC-Dropout | 0.607 | Not recorded | 6a34cd3a206542251d7c6056 |
| Naive | 0.563 | Not recorded | 6a34cd3a206542251d7c6056 |

### UARM

R2 (Top-50): 0.794. Result ID: 6a34f3e2fbc373592c320804.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### Clear

R2 (Top-50): 0.77. Result ID: 6a34f3e2fbc373592c320803.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba31e209131cea8988c.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### MCNF

R2 (Top-50): 0.769. Result ID: 6a34f3e2fbc373592c3207fd.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692e72c3d6b0dd33429324eb.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### SCCP

R2 (Top-50): 0.75. Result ID: 6a34f3e2fbc373592c320802.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683ad.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### TorchNaut

R2 (Top-50): 0.746. Result ID: 6a34f3e2fbc373592c3207fc.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### Packed Ensemble

R2 (Top-50): 0.71. Result ID: 6a34f3e2fbc373592c3207fb.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b891e209131cea88fc3.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### ACI

R2 (Top-50): 0.678. Result ID: 6a34f3e2fbc373592c320801.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b601e209131cea2dd5d.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### DER

R2 (Top-50): 0.663. Result ID: 6a34f3e2fbc373592c3207fa.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68d61e209131cea1e839.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### WCP

R2 (Top-50): 0.646. Result ID: 6a34f3e2fbc373592c320800.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7df41e209131cea94ea9.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### Deep Ensemble

R2 (Top-50): 0.632. Result ID: 6a34f3e2fbc373592c3207f9.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63bc1e209131cea0084f.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### CQR

R2 (Top-50): 0.623. Result ID: 6a34f3e2fbc373592c3207ff.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7dae1e209131cea9411c.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### SCP

R2 (Top-50): 0.609. Result ID: 6a34f3e2fbc373592c3207fe.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa53bd1e209131ce985990.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### MC-Dropout

R2 (Top-50): 0.607. Result ID: 6a34f3e2fbc373592c3207f8.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62d31e209131ce9fb5ff.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### Naive

R2 (Top-50): 0.563. Result ID: 6a34f3e2fbc373592c3207f7.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
