Harmlessness Evaluation on Harmlessness (evaluation set)
48.76Win RateSafeDPO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SafeDPOJudge Model=GPT-4, Evaluation Template=T12025.05 | 48.76 | 48.14 | 3.1 | |
| SafeRLHFJudge Model=GPT-4, Evaluation Template=T12025.05 | 45.98 | 46.75 | 7.28 | |
| DPO-HARMLESSJudge Model=GPT-4, Evaluation Template=T12025.05 | 39.94 | 50.62 | 9.44 | |
| DPO-SAFEBETTERJudge Model=GPT-4, Evaluation Template=T12025.05 | 26.32 | 52.32 | 21.36 | |
| DPO-HELPFULJudge Model=GPT-4, Evaluation Template=T12025.05 | 17.34 | 42.72 | 39.94 |