# CVaR(0.125) Combined Win Rate Evaluation on PKU-SafeRLHF (n=100 Conflict Prompts)

Source: [CVaR(0.125) Combined Win Rate Evaluation on PKU-SafeRLHF (n=100 Conflict Prompts)](<https://www.sota2.com/research/sota/cvar-0-125-combined-win-rate-evaluation-on-pku-saferlhf-n-100-conflict-prompts>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-12T14:02:24.589Z

Evaluation of model performance using the Conditional Value at Risk (CVaR) at the 0.125 level applied to the combined win rate metric, specifically on the 100 conflict prompts subset of the PKU-SafeRLHF dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Combined win rate evaluation |
| Dataset (including any stated split) | PKU-SafeRLHF Conflict prompts n = 100 samples |
| Metric | CVaR(0.125) Combined Win Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [CVaR(0.125) Combined Win Rate](<https://www.sota2.com/research/sota/cvar-0-125-combined-win-rate-evaluation-on-pku-saferlhf-n-100-conflict-prompts.md?metric=CVaR(0.125)%20Combined%20Win%20Rate>): Higher is better; unit: PERCENT.

## Recorded results

| Method | CVaR(0.125) Combined Win Rate | Result date | Report paper |
| --- | --- | --- | --- |
| IPO Entropic τ=10 | 40.3 | Not recorded | 6a02b491dbc836b87d824d17 |
| IPO CVaR α=0.25 | 37.2 | Not recorded | 6a02b491dbc836b87d824d17 |
| IPO Entropic τ=5 | 37.1 | Not recorded | 6a02b491dbc836b87d824d17 |
| IPO CVaR α=0.125 | 34.2 | Not recorded | 6a02b491dbc836b87d824d17 |
| EG Entropic τ=5 | 34.1 | Not recorded | 6a02b491dbc836b87d824d17 |
| IPO k = 1 Neutral | 33.8 | Not recorded | 6a02b491dbc836b87d824d17 |
| EG k = 1 Neutral | 32.4 | Not recorded | 6a02b491dbc836b87d824d17 |
| NMD k = 1 Neutral | 28 | Not recorded | 6a02b491dbc836b87d824d17 |
| EGPO† (HF) | 4.8 | Not recorded | 6a02b491dbc836b87d824d17 |
| SFT Base | 2.4 | Not recorded | 6a02b491dbc836b87d824d17 |

### IPO Entropic τ=10

CVaR(0.125) Combined Win Rate: 40.3. Result ID: 6a03328b47f34ce924e7db08.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

Recorded evaluation configuration: {"tau (τ)":"10","objective":"Entropic"}. This record does not assert independent reproduction.

### IPO CVaR α=0.25

CVaR(0.125) Combined Win Rate: 37.2. Result ID: 6a03328b47f34ce924e7db0a.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

Recorded evaluation configuration: {"alpha (α)":"0.25","objective":"CVaR"}. This record does not assert independent reproduction.

### IPO Entropic τ=5

CVaR(0.125) Combined Win Rate: 37.1. Result ID: 6a03328b47f34ce924e7db07.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

Recorded evaluation configuration: {"tau (τ)":"5","objective":"Entropic"}. This record does not assert independent reproduction.

### IPO CVaR α=0.125

CVaR(0.125) Combined Win Rate: 34.2. Result ID: 6a03328b47f34ce924e7db0b.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

Recorded evaluation configuration: {"alpha (α)":"0.125","objective":"CVaR"}. This record does not assert independent reproduction.

### EG Entropic τ=5

CVaR(0.125) Combined Win Rate: 34.1. Result ID: 6a03328b47f34ce924e7db09.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

Recorded evaluation configuration: {"tau (τ)":"5","objective":"Entropic"}. This record does not assert independent reproduction.

### IPO k = 1 Neutral

CVaR(0.125) Combined Win Rate: 33.8. Result ID: 6a03328b47f34ce924e7db04.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa713c1e209131cea4ff94.md>)

Recorded evaluation configuration: {"k":"1","objective":"Neutral"}. This record does not assert independent reproduction.

### EG k = 1 Neutral

CVaR(0.125) Combined Win Rate: 32.4. Result ID: 6a03328b47f34ce924e7db06.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79e61e209131cea7fdc0.md>)

Recorded evaluation configuration: {"k":"1","objective":"Neutral"}. This record does not assert independent reproduction.

### NMD k = 1 Neutral

CVaR(0.125) Combined Win Rate: 28. Result ID: 6a03328b47f34ce924e7db05.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa739a1e209131cea5d8b7.md>)

Recorded evaluation configuration: {"k":"1","objective":"Neutral"}. This record does not assert independent reproduction.

### EGPO† (HF)

CVaR(0.125) Combined Win Rate: 4.8. Result ID: 6a03328b47f34ce924e7db03.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79e61e209131cea7fdc0.md>)

Recorded evaluation configuration: {"source":"Hugging Face"}. This record does not assert independent reproduction.

### SFT Base

CVaR(0.125) Combined Win Rate: 2.4. Result ID: 6a03328b47f34ce924e7db02.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b491dbc836b87d824d17.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa701f1e209131cea492fe.md>)

[Implementation](<https://github.com/facebookresearch/llama>)

Recorded evaluation configuration: {"type":"Baseline"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
