# Reward Modeling on PKU-SafeRLHF

Source: [Reward Modeling on PKU-SafeRLHF](<https://www.sota2.com/research/sota/reward-modeling-on-pku-saferlhf>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-19T07:53:23.991Z

Evaluation of model performance on the PKU-SafeRLHF dataset for the Reward Modeling task, utilizing metrics such as R2@50, MSE@50, and MAE@50.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Reward Modeling |
| Dataset (including any stated split) | PKU-SafeRLHF |
| Metric | R2@50 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [R2@50](<https://www.sota2.com/research/sota/reward-modeling-on-pku-saferlhf.md?metric=R2%4050>): Higher is better; unit: SCALAR.

- [MSE@50](<https://www.sota2.com/research/sota/reward-modeling-on-pku-saferlhf.md?metric=MSE%4050>): Lower is better; unit: SCALAR.

- [MAE@50](<https://www.sota2.com/research/sota/reward-modeling-on-pku-saferlhf.md?metric=MAE%4050>): Lower is better; unit: SCALAR.

## Recorded results

| Method | R2@50 | Result date | Report paper |
| --- | --- | --- | --- |
| UARM | 0.985 | Not recorded | 6a34cd3a206542251d7c6056 |
| MCNF | 0.955 | Not recorded | 6a34cd3a206542251d7c6056 |
| Clear | 0.94 | Not recorded | 6a34cd3a206542251d7c6056 |
| TorchNaut | 0.933 | Not recorded | 6a34cd3a206542251d7c6056 |
| SCCP | 0.925 | Not recorded | 6a34cd3a206542251d7c6056 |
| Packed Ensemble | 0.905 | Not recorded | 6a34cd3a206542251d7c6056 |
| ACI | 0.905 | Not recorded | 6a34cd3a206542251d7c6056 |
| WCP | 0.883 | Not recorded | 6a34cd3a206542251d7c6056 |
| Deep Ensemble | 0.881 | Not recorded | 6a34cd3a206542251d7c6056 |
| DER | 0.881 | Not recorded | 6a34cd3a206542251d7c6056 |
| CQR | 0.881 | Not recorded | 6a34cd3a206542251d7c6056 |
| SCP | 0.866 | Not recorded | 6a34cd3a206542251d7c6056 |
| MC-Dropout | 0.863 | Not recorded | 6a34cd3a206542251d7c6056 |
| Naive | 0.85 | Not recorded | 6a34cd3a206542251d7c6056 |

### UARM

R2@50: 0.985. Result ID: 6a34f3e2fbc373592c320812.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### MCNF

R2@50: 0.955. Result ID: 6a34f3e2fbc373592c32080b.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692e72c3d6b0dd33429324eb.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### Clear

R2@50: 0.94. Result ID: 6a34f3e2fbc373592c320811.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba31e209131cea8988c.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### TorchNaut

R2@50: 0.933. Result ID: 6a34f3e2fbc373592c32080a.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### SCCP

R2@50: 0.925. Result ID: 6a34f3e2fbc373592c320810.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683ad.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### Packed Ensemble

R2@50: 0.905. Result ID: 6a34f3e2fbc373592c320809.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b891e209131cea88fc3.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### ACI

R2@50: 0.905. Result ID: 6a34f3e2fbc373592c32080f.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b601e209131cea2dd5d.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### WCP

R2@50: 0.883. Result ID: 6a34f3e2fbc373592c32080e.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7df41e209131cea94ea9.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### Deep Ensemble

R2@50: 0.881. Result ID: 6a34f3e2fbc373592c320807.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63bc1e209131cea0084f.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### DER

R2@50: 0.881. Result ID: 6a34f3e2fbc373592c320808.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68d61e209131cea1e839.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### CQR

R2@50: 0.881. Result ID: 6a34f3e2fbc373592c32080d.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7dae1e209131cea9411c.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### SCP

R2@50: 0.866. Result ID: 6a34f3e2fbc373592c32080c.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa53bd1e209131ce985990.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### MC-Dropout

R2@50: 0.863. Result ID: 6a34f3e2fbc373592c320806.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62d31e209131ce9fb5ff.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

### Naive

R2@50: 0.85. Result ID: 6a34f3e2fbc373592c320805.

[Reporting paper](<https://www.sota2.com/research/paper/6a34cd3a206542251d7c6056.md>)

Recorded evaluation configuration: {"Miscoverage rate (alpha)":"0.1","Confidence threshold":"50% most confident samples"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
