Safe RLHF Alignment on PKU-SafeRLHF 30K
6.51HelpfulnessMoCAN
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MoCANlambda=0.5, Base Model=Alpaca-7b2025.05 | 6.51 | 40.13 | -1.59 | |
| MoCANlambda=0.9, Base Model=Alpaca-7b2025.05 | 6.02 | 45.13 | -0.91 | |
| MoCANlambda=2.0, Base Model=Alpaca-7b2025.05 | 5.97 | 49.75 | -0.24 | |
| MoCANlambda=0.1, Base Model=Alpaca-7b2025.05 | 5.97 | 40.5 | -1.64 | |
| PeCANlambda=0.15, Base Model=Alpaca-7b2025.05 | 5.35 | 48.38 | -0.38 | |
| PeCANlambda=1.0, Base Model=Alpaca-7b2025.05 | 0.85 | 87.88 | 3.94 | |
| PeCANlambda=3.2, Base Model=Alpaca-7b2025.05 | 0.61 | 90.63 | 4.33 |