Jailbreak Defense on Dictionary-based Jailbreak Evaluation
0GCG ASRIntention Analysis
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Intention AnalysisBase LLM=Vicuna2025.08 | 0 | 0 | 10 | 2 | 0 | 46 | |
| Self-ReminderBase LLM=Llama22025.08 | 0 | 2 | 6 | 14 | 2 | — | |
| Intention AnalysisBase LLM=Llama22025.08 | 0 | 0 | 0 | 0 | 0 | — | |
| Safe DecodingBase LLM=Llama22025.08 | 0 | 0 | 10 | 4 | 0 | — | |
| Context FilteringBase LLM=Llama22025.08 | 0 | 0 | 0 | 2 | 0 | — | |
| Self-ReminderBase LLM=ChatGPT2025.08 | 0 | 0 | 6 | 24 | 72 | 86 | |
| ICDBase LLM=ChatGPT2025.08 | 0 | 2 | 2 | 4 | 0 | 80 | |
| Self-ExaminationBase LLM=ChatGPT2025.08 | 0 | 0 | 4 | 4 | 60 | 28 | |
| Intention AnalysisBase LLM=ChatGPT2025.08 | 0 | 0 | 0 | 2 | 0 | 0 | |
| Context FilteringBase LLM=ChatGPT2025.08 | 0 | 0 | 0 | 2 | 8 | 28 | |
| ICDBase LLM=Llama22025.08 | 2 | 0 | 4 | 0 | 0 | — | |
| Safe DecodingBase LLM=Vicuna2025.08 | 4 | 0 | 20 | 4 | 0 | 96 | |
| No DefenseBase LLM=ChatGPT2025.08 | 4 | 4 | 20 | 34 | 82 | 94 | |
| Context FilteringBase LLM=Vicuna2025.08 | 6 | 2 | 10 | 18 | 10 | 48 | |
| Self-ExaminationBase LLM=Vicuna2025.08 | 12 | 4 | 24 | 12 | 88 | 88 | |
| Self-ExaminationBase LLM=Llama22025.08 | 12 | 0 | 2 | 0 | 2 | — | |
| No DefenseBase LLM=Llama22025.08 | 32 | 2 | 2 | 18 | 10 | 0 | |
| Self-ReminderBase LLM=Vicuna2025.08 | 48 | 68 | 44 | 46 | 100 | 98 | |
| ICDBase LLM=Vicuna2025.08 | 72 | 80 | 58 | 40 | 40 | 96 | |
| No DefenseBase LLM=Vicuna2025.08 | 98 | 88 | 56 | 88 | 100 | 100 |