Jailbreak Defense on Common Jailbreak Attacks Suite (Qwen3.5-9B)
0IJP ASR (Manual)Qwen3.5-9B (No Defense)
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3.5-9B (No Defense)Defense=None2026.04 | 0 | — | 0 | — | 0 | — | 0 | — | 32 | — | 33 | — | 11 | — | 9.5 | — | |
| Perplexity Filter2026.04 | 0 | 100 | 0 | 62 | 0 | 100 | 0 | 100 | 32 | 100 | 33 | 100 | 11 | 93.67 | 0.1 | 13,073.1 | |
| GradientCuff2026.04 | 0 | 100 | 0 | 100 | 0 | 100 | 0 | 100 | 32 | 100 | 33 | 100 | 10 | 100 | 73.69 | 1,427.98 | |
| Prompt Guard2026.04 | 0 | 0 | 0 | 8 | 0 | 42 | 0 | 94 | 32 | 100 | 33 | 97.55 | 10 | 56.92 | 7.77 | 1,174.32 | |
| Llama GuardEvaluation Stage=Pre-processing2026.04 | 0 | 56.1 | 0 | 39 | 0 | 50 | 0 | 84 | 32 | 95.24 | 33 | 98.67 | 11 | 70.5 | 0.4 | 13,547.56 | |
| Llama GuardEvaluation Stage=Post-processing2026.04 | 0 | 54.9 | 0 | 34 | 0 | 45 | 0 | 75 | 0 | 69.21 | 33 | 91.33 | 11 | 61.57 | 0.52 | 13,694.89 | |
| SelfDefendMethod Configuration=Direct2026.04 | 0 | 25.8 | 0 | 8 | 0 | 15 | 0 | 58 | 32 | 70.48 | 33 | 60.5 | 11 | 39.63 | 0.68 | 13,086.41 | |
| SelfDefendMethod Configuration=Intent2026.04 | 0 | 29.4 | 0 | 8 | 0 | 11 | 0 | 14 | 32 | 60 | 33 | 48.83 | 11 | 28.54 | 1.99 | 13,091.62 | |
| WildGuardEvaluation Stage=Pre-processing2026.04 | 0 | 3.4 | 0 | 2 | 0 | 2 | 0 | 50 | 32 | 80 | 33 | 93.17 | 11 | 38.43 | 1.05 | 13,921.18 | |
| WildGuardEvaluation Stage=Post-processing2026.04 | 0 | 74.8 | 0 | 78 | 0 | 72 | 0 | 64 | 0 | 87.62 | 33 | 98.67 | 11 | 79.18 | 0.98 | 13,979.57 | |
| GuardReasonerEvaluation Stage=Pre-processing2026.04 | 0 | 0.9 | 0 | 0 | 0 | 1 | 0 | 36 | 0 | 36.19 | — | — | 0 | 14.82 | — | — | |
| GuardReasonerEvaluation Stage=Post-processing2026.04 | 0 | 82.7 | 0 | 73 | 0 | 73 | 0 | 80 | 0 | 85.71 | — | — | 0 | 78.88 | — | — | |
| SelfGrader2026.04 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1.25 | 355.97 |