Jailbreak Defense on Prefix-Probe-600 Vicuna-7B
1GCG ScorePPL
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PPLBase Model=Vicuna-7B2025.10 | 1 | 4.86 | 4.6 | 3.68 | 4.31 | 3.68 | 3.69 | |
| PPLBase Model=Guanaco2025.10 | 1 | 4.68 | 3.64 | 4.46 | 3.8 | 1.6 | 3.2 | |
| SAIDBase Model=Vicuna-7B2025.10 | 1.08 | 1 | 1.16 | 1 | 1.03 | 1 | 1.05 | |
| SafeDecodingBase Model=Vicuna-7B2025.10 | 1.18 | 1.08 | 1.22 | 1.02 | 1.38 | 3.58 | 1.58 | |
| SAIDBase Model=Guanaco2025.10 | 1.18 | 1.12 | 1.28 | 1.94 | 1.04 | 1.08 | 1.27 | |
| Self-ExaminationBase Model=Vicuna-7B2025.10 | 1.38 | 1.12 | 1.62 | 3.38 | 1.53 | 1.74 | 1.8 | |
| SafeDecodingBase Model=Guanaco2025.10 | 1.78 | 1.52 | 1.48 | 1.74 | 1.87 | 1.3 | 1.62 | |
| RetokenizationBase Model=Guanaco2025.10 | 1.8 | 1.8 | 2.32 | 2.88 | 2.38 | 2.96 | 2.36 | |
| ParaphraseBase Model=Vicuna-7B2025.10 | 1.86 | 3.26 | 2.26 | 3.88 | 2.88 | 2.26 | 2.73 | |
| Self-ExaminationBase Model=Guanaco2025.10 | 2 | 1.74 | 2.06 | 1.8 | 2.11 | 2.24 | 1.99 | |
| RetokenizationBase Model=Vicuna-7B2025.10 | 2.22 | 2.82 | 3.56 | 3.2 | 4.02 | 2.92 | 3.12 | |
| ParaphraseBase Model=Guanaco2025.10 | 2.48 | 2.42 | 2.28 | 4.04 | 2.15 | 2.62 | 2.67 | |
| ICDBase Model=Guanaco2025.10 | 3.7 | 4.7 | 2.56 | 4.2 | 3.2 | 2.06 | 3.4 | |
| ICDBase Model=Vicuna-7B2025.10 | 4.06 | 4.52 | 2.7 | 3.8 | 2.91 | 3.56 | 3.59 | |
| No DefenseBase Model=Guanaco2025.10 | 4.42 | 4.68 | 3.64 | 4.54 | 3.81 | 3.84 | 4.16 | |
| No DefenseBase Model=Vicuna-7B2025.10 | 4.8 | 4.86 | 4.68 | 3.68 | 4.31 | 3.7 | 4.34 |