CVaR(0.125) Combined Win Rate Evaluation on PKU-SafeRLHF (n=100 Conflict Prompts)
40.3CVaR(0.125) Combined Win RateIPO Entropic τ=10
Evaluation Results
| Method | Links | |
|---|---|---|
| IPO Entropic τ=10tau (τ)=10, objective=Entropic2026.05 | 40.3 | |
| IPO CVaR α=0.25alpha (α)=0.25, objective=CVaR2026.05 | 37.2 | |
| IPO Entropic τ=5tau (τ)=5, objective=Entropic2026.05 | 37.1 | |
| IPO CVaR α=0.125alpha (α)=0.125, objective=CVaR2026.05 | 34.2 | |
| EG Entropic τ=5tau (τ)=5, objective=Entropic2026.05 | 34.1 | |
| IPO k = 1 Neutralk=1, objective=Neutral2026.05 | 33.8 | |
| EG k = 1 Neutralk=1, objective=Neutral2026.05 | 32.4 | |
| NMD k = 1 Neutralk=1, objective=Neutral2026.05 | 28 | |
| EGPO† (HF)source=Hugging Face2026.05 | 4.8 | |
| SFT Basetype=Baseline2026.05 | 2.4 |