Combined win rate evaluation on PKU-SafeRLHF prompts n = 100 samples (Sev-Low)
53.6CVaR(0.125) Combined Win RateIPO Entropic τ=10
Evaluation results
| Method | Links | |
|---|---|---|
| IPO Entropic τ=10tau (τ)=10, objective=Entropic2026.05 | 53.6 | |
| IPO k = 1 Neutralk=1, objective=Neutral2026.05 | 50.8 | |
| IPO CVaR α=0.25alpha (α)=0.25, objective=CVaR2026.05 | 49.4 | |
| IPO Entropic τ=5tau (τ)=5, objective=Entropic2026.05 | 48.8 | |
| IPO CVaR α=0.125alpha (α)=0.125, objective=CVaR2026.05 | 48.6 | |
| EG Entropic τ=5tau (τ)=5, objective=Entropic2026.05 | 44.5 | |
| EG k = 1 Neutralk=1, objective=Neutral2026.05 | 41.2 | |
| NMD k = 1 Neutralk=1, objective=Neutral2026.05 | 39.2 | |
| EGPO† (HF)source=Hugging Face2026.05 | 9.1 | |
| SFT Basetype=Baseline2026.05 | 2.4 |