Safety Alignment Evaluation on PKU-SafeRLHF 30K (test)
90.23Win Rate (WR)wDPO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| wDPOBackbone=Qwen2.5-7B2026.03 | 90.23 | 1.63 | 0 | |
| Dr.DPOBackbone=Qwen2.5-7B2026.03 | 88.93 | 2.01 | 0.13 | |
| wDPOBackbone=Llama-3.2-3B2026.03 | 85.45 | 1.63 | 0.13 | |
| wDPOBackbone=Llama-3-8B2026.03 | 84.01 | 4.51 | 0.38 | |
| Dr.DPOBackbone=Llama-3.2-3B2026.03 | 83.77 | 2.38 | 0.5 | |
| rDPOBackbone=Qwen2.5-7B2026.03 | 82.74 | 4.51 | 2.01 | |
| Dr.DPOBackbone=Llama-3-8B2026.03 | 82.5 | 4.39 | 0.5 | |
| rDPOBackbone=Llama-3-8B2026.03 | 82.13 | 6.64 | 3.26 | |
| rDPOBackbone=Llama-3.2-3B2026.03 | 81.3 | 4.14 | 1.75 | |
| DPOBackbone=Qwen2.5-7B2026.03 | 75.81 | 20.55 | 7.27 | |
| IPOBackbone=Qwen2.5-7B2026.03 | 73.97 | 21.3 | 8.02 | |
| DPOBackbone=Llama-3.2-3B2026.03 | 73.7 | 11.28 | 6.14 | |
| cDPOBackbone=Llama-3.2-3B2026.03 | 72.91 | 25.44 | 12.78 | |
| IPOBackbone=Llama-3.2-3B2026.03 | 72.7 | 11.78 | 6.14 | |
| IPOBackbone=Llama-3-8B2026.03 | 70.22 | 26.82 | 13.53 | |
| DPOBackbone=Llama-3-8B2026.03 | 69.19 | 26.57 | 14.41 | |
| VanillaBackbone=Qwen2.5-7B2026.03 | 69.09 | 32.21 | 13.16 | |
| cDPOBackbone=Qwen2.5-7B2026.03 | 67.65 | 31.83 | 13.66 | |
| wDPOBackbone=Pythia-2.8B2026.03 | 59.92 | 13.03 | 3.01 | |
| cDPOBackbone=Llama-3-8B2026.03 | 59.48 | 37.94 | 23.43 | |
| Dr.DPOBackbone=Pythia-2.8B2026.03 | 57.41 | 17.04 | 4.14 | |
| rDPOBackbone=Pythia-2.8B2026.03 | 46.54 | 57.77 | 23.43 | |
| IPOBackbone=Pythia-2.8B2026.03 | 45.27 | 61.65 | 22.68 | |
| cDPOBackbone=Pythia-2.8B2026.03 | 45.27 | 60.28 | 16.92 | |
| VanillaBackbone=Llama-3.2-3B2026.03 | 44.93 | 66.79 | 18.42 | |
| DPOBackbone=Pythia-2.8B2026.03 | 44.23 | 57.14 | 19.17 | |
| VanillaBackbone=Llama-3-8B2026.03 | 42.82 | 67.54 | 24.69 | |
| SFTBackbone=Pythia-2.8B2026.03 | 41.05 | 71.3 | 26.32 | |
| VanillaBackbone=Pythia-2.8B2026.03 | 40.18 | 73.31 | 26.94 | |
| SFTBackbone=Llama-3.2-3B2026.03 | 35.93 | 68.67 | 45.36 | |
| SFTBackbone=Qwen2.5-7B2026.03 | 25.09 | 70.55 | 52.88 | |
| SFTBackbone=Llama-3-8B2026.03 | 23.85 | 69.92 | 52.51 |