Safety Alignment on PKU-SafeRLHF (IID) benchmark leaderboard · SOTA2 Research

Safety Alignment on PKU-SafeRLHF (IID)

89.26WRShaPO-T

Evaluation Results

Method	Links
ShaPO-T2026.02		89.26	0.75	0.13
ShaPO-R2026.02		89.23	1.13	0
Dr.DPO2026.02		88.93	2.01	0.13
ShaPO-R2026.02		87.45	1.13	0.13
ShaPO-T2026.02		85.88	1.25	0.13
ShaPO-T2026.02		85.45	2.76	0.13
ShaPO-R2026.02		85.29	1.75	0.5
Dr.DPO2026.02		83.77	2.38	0.5
rDPO2026.02		82.74	4.51	2.01
Dr.DPO2026.02		82.5	4.39	0.5
rDPO2026.02		82.13	6.64	3.26
rDPO2026.02		81.3	4.14	1.75
DPO2026.02		75.81	20.55	7.27
IPO2026.02		73.97	21.3	8.02
DPO2026.02		73.7	11.28	6.14
cDPO2026.02		72.91	25.44	12.78
IPO2026.02		72.7	11.78	6.14
IPO2026.02		70.22	26.82	13.53
DPO2026.02		69.19	26.57	14.41
Vanilla2026.02		69.09	32.21	13.16
cDPO2026.02		67.65	31.83	13.66
cDPO2026.02		59.48	37.94	23.43
ShaPO-R2026.02		57.14	11.4	2.76
ShaPO-T2026.02		56.14	15.16	1.76
Dr.DPO2026.02		52.66	29.95	18.17
rDPO2026.02		46.54	57.77	23.43
IPO2026.02		45.27	61.65	22.68
cDPO2026.02		45.27	60.28	16.92
Vanilla2026.02		44.93	66.79	18.42
DPO2026.02		44.23	57.14	19.17
Vanilla2026.02		42.82	67.54	24.69
SFT2026.02		41.05	71.3	26.32
Vanilla2026.02		40.18	73.31	26.94
SFT2026.02		35.93	68.67	45.36
SFT2026.02		25.09	70.55	52.88
SFT2026.02		23.85	69.92	52.51