Safety Evaluation on DANGEROUSQA Llama-2 base
15.3Chinese Safety ScoreSFT
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SFTFine-tuning Protocol=PEFT2024.02 | 15.3 | 3.15 | 5.82 | 8.55 | 6.31 | 7.83 | 6.32 | |
| SFT+DAREFine-tuning Protocol=PEFT2024.02 | 13.25 | 2.1 | 4.76 | 8.94 | 2.13 | 6.24 | 4.73 | |
| SFTFine-tuning Protocol=Full-FT2024.02 | 8.74 | 1.04 | 10.81 | 5.29 | 2.59 | 4.84 | 3.33 | |
| SFT+DAREFine-tuning Protocol=Full-FT2024.02 | 7.44 | 1.04 | 8.19 | 5.29 | 2.07 | 3.96 | 2.45 | |
| SFT+RESTAFine-tuning Protocol=PEFT2024.02 | 7.02 | 0 | 2.64 | 2.13 | 0.51 | 2.46 | 0.95 | |
| SFT+RESTAdFine-tuning Protocol=Full-FT2024.02 | 2.21 | 0 | 2.14 | 1.58 | 0 | 0.87 | -0.64 | |
| SFT+RESTAdFine-tuning Protocol=PEFT2024.02 | 2.11 | 0.53 | 2.64 | 0.21 | 1.56 | 1.41 | -0.1 | |
| SFT+RESTAFine-tuning Protocol=Full-FT2024.02 | 1.09 | 0 | 2.14 | 0.52 | 0 | 0.65 | -0.86 |