Safety Alignment on PKU-SafeRLHF (IID)
89.26WRShaPO-T
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ShaPO-TBackbone=Qwen2.5-7B2026.02 | 89.26 | 0.75 | 0.13 | |
| ShaPO-RBackbone=Qwen2.5-7B2026.02 | 89.23 | 1.13 | 0 | |
| Dr.DPOBackbone=Qwen2.5-7B2026.02 | 88.93 | 2.01 | 0.13 | |
| ShaPO-RBackbone=LLaMA-3-8B2026.02 | 87.45 | 1.13 | 0.13 | |
| ShaPO-TBackbone=LLaMA-3.2-3B2026.02 | 85.88 | 1.25 | 0.13 | |
| ShaPO-TBackbone=LLaMA-3-8B2026.02 | 85.45 | 2.76 | 0.13 | |
| ShaPO-RBackbone=LLaMA-3.2-3B2026.02 | 85.29 | 1.75 | 0.5 | |
| Dr.DPOBackbone=LLaMA-3.2-3B2026.02 | 83.77 | 2.38 | 0.5 | |
| rDPOBackbone=Qwen2.5-7B2026.02 | 82.74 | 4.51 | 2.01 | |
| Dr.DPOBackbone=LLaMA-3-8B2026.02 | 82.5 | 4.39 | 0.5 | |
| rDPOBackbone=LLaMA-3-8B2026.02 | 82.13 | 6.64 | 3.26 | |
| rDPOBackbone=LLaMA-3.2-3B2026.02 | 81.3 | 4.14 | 1.75 | |
| DPOBackbone=Qwen2.5-7B2026.02 | 75.81 | 20.55 | 7.27 | |
| IPOBackbone=Qwen2.5-7B2026.02 | 73.97 | 21.3 | 8.02 | |
| DPOBackbone=LLaMA-3.2-3B2026.02 | 73.7 | 11.28 | 6.14 | |
| cDPOBackbone=LLaMA-3.2-3B2026.02 | 72.91 | 25.44 | 12.78 | |
| IPOBackbone=LLaMA-3.2-3B2026.02 | 72.7 | 11.78 | 6.14 | |
| IPOBackbone=LLaMA-3-8B2026.02 | 70.22 | 26.82 | 13.53 | |
| DPOBackbone=LLaMA-3-8B2026.02 | 69.19 | 26.57 | 14.41 | |
| VanillaBackbone=Qwen2.5-7B2026.02 | 69.09 | 32.21 | 13.16 | |
| cDPOBackbone=Qwen2.5-7B2026.02 | 67.65 | 31.83 | 13.66 | |
| cDPOBackbone=LLaMA-3-8B2026.02 | 59.48 | 37.94 | 23.43 | |
| ShaPO-RBackbone=Pythia-2.8B2026.02 | 57.14 | 11.4 | 2.76 | |
| ShaPO-TBackbone=Pythia-2.8B2026.02 | 56.14 | 15.16 | 1.76 | |
| Dr.DPOBackbone=Pythia-2.8B2026.02 | 52.66 | 29.95 | 18.17 | |
| rDPOBackbone=Pythia-2.8B2026.02 | 46.54 | 57.77 | 23.43 | |
| IPOBackbone=Pythia-2.8B2026.02 | 45.27 | 61.65 | 22.68 | |
| cDPOBackbone=Pythia-2.8B2026.02 | 45.27 | 60.28 | 16.92 | |
| VanillaBackbone=LLaMA-3.2-3B2026.02 | 44.93 | 66.79 | 18.42 | |
| DPOBackbone=Pythia-2.8B2026.02 | 44.23 | 57.14 | 19.17 | |
| VanillaBackbone=LLaMA-3-8B2026.02 | 42.82 | 67.54 | 24.69 | |
| SFTBackbone=Pythia-2.8B2026.02 | 41.05 | 71.3 | 26.32 | |
| VanillaBackbone=Pythia-2.8B2026.02 | 40.18 | 73.31 | 26.94 | |
| SFTBackbone=LLaMA-3.2-3B2026.02 | 35.93 | 68.67 | 45.36 | |
| SFTBackbone=Qwen2.5-7B2026.02 | 25.09 | 70.55 | 52.88 | |
| SFTBackbone=LLaMA-3-8B2026.02 | 23.85 | 69.92 | 52.51 |