Jailbreak Defense on HEX-PHI
1.74Harmful ScoreRetokenization
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RetokenizationModel=Vicuna2024.02 | 1.74 | 33 | |
| ParaphraseModel=Vicuna2024.02 | 1.71 | 23 | |
| Self-ExaminationModel=Vicuna2024.02 | 1.61 | 8 | |
| No DefenseModel=Vicuna2024.02 | 1.58 | 17 | |
| PPLModel=Vicuna2024.02 | 1.52 | 15 | |
| Self-ReminderModel=Vicuna2024.02 | 1.23 | 8 | |
| ICDModel=Vicuna2024.02 | 1.2 | 6 | |
| SafeDecodingModel=Vicuna2024.02 | 1.08 | 1 | |
| RetokenizationModel=Llama22024.02 | 1.04 | 15 | |
| ICDModel=Llama22024.02 | 1.03 | 0 | |
| ParaphraseModel=Llama22024.02 | 1.02 | 3 | |
| No DefenseModel=Llama22024.02 | 1.01 | 2 | |
| PPLModel=Llama22024.02 | 1.01 | 2 | |
| Self-ExaminationModel=Llama22024.02 | 1.01 | 0 | |
| SafeDecodingModel=Llama22024.02 | 1.01 | 1 | |
| Self-ReminderModel=Llama22024.02 | 1 | 0 |