Jailbreak Robustness on JailbreakBench
0Harmbench ASRLLaDA-Instruct
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LLaDA-InstructAttack=Zero-shot, Defence=PPL, Setting=Base2026.04 | 0 | 97 | — | — | — | — | |
| LLaDA-InstructAttack=Zero-shot, Defence=Self-rem., Setting=Base2026.04 | 0 | 97 | — | — | — | — | |
| LLaDA-InstructAttack=Zero-shot, Defence=Self-rem., Setting=+SAD2026.04 | 0 | 9 | — | — | — | — | |
| LLaDA-1.5Attack=Zero-shot, Defence=None, Setting=Base2026.04 | 0 | 96 | — | — | — | — | |
| LLaDA-1.5Attack=Zero-shot, Defence=PPL, Setting=Base2026.04 | 0 | 96 | — | — | — | — | |
| LLaDA-1.5Attack=Zero-shot, Defence=Self-rem., Setting=Base2026.04 | 0 | 96 | — | — | — | — | |
| LLaDA-1.5Attack=Zero-shot, Defence=Self-rem., Setting=+SAD2026.04 | 0 | 8 | — | — | — | — | |
| Dream-InstructAttack=Zero-shot, Defence=None, Setting=Base2026.04 | 0 | 90 | — | — | — | — | |
| Dream-InstructAttack=Zero-shot, Defence=None, Setting=+SAD2026.04 | 0 | 36.2 | — | — | — | — | |
| Dream-InstructAttack=Zero-shot, Defence=PPL, Setting=Base2026.04 | 0 | 90 | — | — | — | — | |
| Dream-InstructAttack=Zero-shot, Defence=PPL, Setting=+SAD2026.04 | 0 | 36.2 | — | — | — | — | |
| Dream-InstructAttack=Zero-shot, Defence=Self-rem., Setting=Base2026.04 | 0 | 90 | — | — | — | — | |
| Dream-InstructAttack=Zero-shot, Defence=Self-rem., Setting=+SAD2026.04 | 0 | 36.2 | — | — | — | — | |
| Dream-InstructAttack=Zero-shot, Defence=DiffuGuard, Setting=Base2026.04 | 0 | 90 | — | — | — | — | |
| Dream-InstructAttack=Zero-shot, Defence=DiffuGuard, Setting=+SAD2026.04 | 0 | 36.2 | — | — | — | — | |
| LLaDA-InstructAttack=Zero-shot, Defence=None, Setting=Base2026.04 | 1 | 97 | — | — | — | — | |
| LLaDA-InstructAttack=Zero-shot, Defence=DiffuGuard, Setting=Base2026.04 | 1 | 97 | — | — | — | — | |
| LLaDA-1.5Attack=Zero-shot, Defence=None, Setting=+SAD2026.04 | 1 | 8 | — | — | — | — | |
| LLaDA-1.5Attack=Zero-shot, Defence=PPL, Setting=+SAD2026.04 | 1 | 8 | — | — | — | — | |
| LLaDA-1.5Attack=Zero-shot, Defence=DiffuGuard, Setting=Base2026.04 | 1 | 96 | — | — | — | — | |
| LLaDA-1.5Attack=Zero-shot, Defence=DiffuGuard, Setting=+SAD2026.04 | 1 | 8 | — | — | — | — | |
| HARC + DPOBackbone=LLAMA-3.1-8B2026.07 | 1.5 | — | 0 | 0 | 0 | 6 | |
| RepBendBackbone=QWEN-2.5-7B2026.07 | 1.9 | — | 3.2 | 1.5 | 0.3 | 2.5 | |
| LLaDA-InstructAttack=Zero-shot, Defence=None, Setting=+SAD2026.04 | 2 | 9 | — | — | — | — | |
| LLaDA-InstructAttack=Zero-shot, Defence=PPL, Setting=+SAD2026.04 | 2 | 9 | — | — | — | — | |
| LLaDA-InstructAttack=Zero-shot, Defence=DiffuGuard, Setting=+SAD2026.04 | 3 | 9 | — | — | — | — | |
| Dream-InstructAttack=PAD, Defence=Self-rem., Setting=+SAD2026.04 | 4 | 50 | — | — | — | — | |
| DPOBackbone=LLAMA-3.1-8B2026.07 | 6.7 | — | 3.5 | 4 | 3.5 | 15.7 | |
| Dream-InstructAttack=PAD, Defence=Self-rem., Setting=Base2026.04 | 7 | 53 | — | — | — | — | |
| RepBendBackbone=LLAMA-3.1-8B2026.07 | 7.8 | — | 1.3 | 0.3 | 0 | 29.5 | |
| HARCBackbone=LLAMA-3.1-8B2026.07 | 9.2 | — | 6 | 1 | 1 | 29 | |
| LLaDA-1.5Attack=DIJA, Defence=PPL, Setting=Base2026.04 | 11 | 0 | — | — | — | — | |
| LLaDA-1.5Attack=DIJA, Defence=PPL, Setting=+SAD2026.04 | 11 | 0 | — | — | — | — | |
| LLaDA-InstructAttack=DIJA, Defence=PPL, Setting=Base2026.04 | 12 | 1 | — | — | — | — | |
| Circuit BreakerBackbone=LLAMA-3.1-8B2026.07 | 12 | — | 11.7 | 3.5 | 5.2 | 27.7 | |
| LLaDA-InstructAttack=DIJA, Defence=PPL, Setting=+SAD2026.04 | 12.6 | 0 | — | — | — | — | |
| LLaDA-1.5Attack=PAD, Defence=Self-rem., Setting=+SAD2026.04 | 13 | 1 | — | — | — | — | |
| HARCBackbone=QWEN-2.5-7B2026.07 | 13.3 | — | 14 | 4 | 1 | 34 | |
| LLaDA-1.5Attack=PAD, Defence=Self-rem., Setting=Base2026.04 | 15 | 0 | — | — | — | — | |
| SFTBackbone=LLAMA-3.1-8B2026.07 | 15.7 | — | 4.7 | 3.7 | 9 | 45.5 | |
| Dream-InstructAttack=PAD, Defence=PPL, Setting=+SAD2026.04 | 18 | 50 | — | — | — | — | |
| Dream-InstructAttack=PAD, Defence=None, Setting=Base2026.04 | 19 | 53 | — | — | — | — | |
| Dream-InstructAttack=PAD, Defence=DiffuGuard, Setting=+SAD2026.04 | 19 | 50 | — | — | — | — | |
| Dream-InstructAttack=PAD, Defence=None, Setting=+SAD2026.04 | 21 | 50 | — | — | — | — | |
| Dream-InstructAttack=PAD, Defence=DiffuGuard, Setting=Base2026.04 | 25 | 53 | — | — | — | — | |
| SFTBackbone=QWEN-2.5-7B2026.07 | 25.7 | — | 15.7 | 27.5 | 9 | 50.5 | |
| HARC + DPOBackbone=QWEN-2.5-7B2026.07 | 26 | — | 35 | 27 | 23 | 19 | |
| LLaDA-InstructAttack=PAD, Defence=Self-rem., Setting=+SAD2026.04 | 29 | 4 | — | — | — | — | |
| LLaDA-InstructAttack=PAD, Defence=Self-rem., Setting=Base2026.04 | 31 | 0 | — | — | — | — | |
| Dream-InstructAttack=PAD, Defence=PPL, Setting=Base2026.04 | 31 | 53 | — | — | — | — | |
| DPOBackbone=QWEN-2.5-7B2026.07 | 32.4 | — | 34.5 | 39.7 | 15.7 | 39.7 | |
| CASTBackbone=LLAMA-3.1-8B2026.07 | 35.5 | — | 37.3 | 48.8 | 21.5 | 34.3 | |
| LLaDA-1.5Attack=PAD, Defence=DiffuGuard, Setting=+SAD2026.04 | 37 | 1 | — | — | — | — | |
| LLaDA-1.5Attack=PAD, Defence=None, Setting=+SAD2026.04 | 38 | 1 | — | — | — | — | |
| LLaDA-InstructAttack=PAD, Defence=None, Setting=+SAD2026.04 | 42 | 4 | — | — | — | — | |
| LLaDA-InstructAttack=PAD, Defence=DiffuGuard, Setting=+SAD2026.04 | 42 | 4 | — | — | — | — | |
| BaselineBackbone=LLAMA-3.1-8B2026.07 | 43 | — | 47 | 65.5 | 24.5 | 35 | |
| LLaDA-1.5Attack=PAD, Defence=PPL, Setting=+SAD2026.04 | 50 | 1 | — | — | — | — | |
| Circuit BreakerBackbone=QWEN-2.5-7B2026.07 | 50.9 | — | 51.5 | 48.3 | 64.7 | 39.2 | |
| LLaDA-1.5Attack=PAD, Defence=PPL, Setting=Base2026.04 | 52 | 0 | — | — | — | — | |
| LLaDA-1.5Attack=PAD, Defence=None, Setting=Base2026.04 | 53 | 0 | — | — | — | — | |
| LLaDA-InstructAttack=PAD, Defence=PPL, Setting=+SAD2026.04 | 54.9 | 4 | — | — | — | — | |
| LLaDA-1.5Attack=PAD, Defence=DiffuGuard, Setting=Base2026.04 | 55 | 0 | — | — | — | — | |
| LLaDA-InstructAttack=PAD, Defence=PPL, Setting=Base2026.04 | 55.1 | 0 | — | — | — | — | |
| CASTBackbone=QWEN-2.5-7B2026.07 | 58.9 | — | 69.5 | 68.8 | 57 | 40.2 | |
| LLaDA-InstructAttack=PAD, Defence=None, Setting=Base2026.04 | 59 | 0 | — | — | — | — | |
| LLaDA-InstructAttack=PAD, Defence=DiffuGuard, Setting=Base2026.04 | 59 | 0 | — | — | — | — | |
| BaselineBackbone=QWEN-2.5-7B2026.07 | 63.2 | — | 74.8 | 72.8 | 63.7 | 41.7 | |
| Dream-InstructAttack=DIJA, Defence=DiffuGuard, Setting=+SAD2026.04 | 71 | 0 | — | — | — | — | |
| LLaDA-InstructAttack=DIJA, Defence=None, Setting=+SAD2026.04 | 72 | 0 | — | — | — | — | |
| LLaDA-InstructAttack=DIJA, Defence=DiffuGuard, Setting=+SAD2026.04 | 73 | 0 | — | — | — | — | |
| LLaDA-InstructAttack=DIJA, Defence=Self-rem., Setting=+SAD2026.04 | 74 | 0 | — | — | — | — | |
| LLaDA-1.5Attack=DIJA, Defence=Self-rem., Setting=+SAD2026.04 | 74 | 0 | — | — | — | — | |
| LLaDA-1.5Attack=DIJA, Defence=DiffuGuard, Setting=+SAD2026.04 | 75 | 0 | — | — | — | — | |
| LLaDA-InstructAttack=DIJA, Defence=Self-rem., Setting=Base2026.04 | 76 | 1 | — | — | — | — | |
| Dream-InstructAttack=DIJA, Defence=Self-rem., Setting=Base2026.04 | 76 | 0 | — | — | — | — | |
| LLaDA-1.5Attack=DIJA, Defence=None, Setting=+SAD2026.04 | 77 | 0 | — | — | — | — | |
| LLaDA-InstructAttack=DIJA, Defence=None, Setting=Base2026.04 | 78 | 1 | — | — | — | — | |
| LLaDA-InstructAttack=DIJA, Defence=DiffuGuard, Setting=Base2026.04 | 78 | 1 | — | — | — | — | |
| LLaDA-1.5Attack=DIJA, Defence=None, Setting=Base2026.04 | 78 | 0 | — | — | — | — | |
| LLaDA-1.5Attack=DIJA, Defence=Self-rem., Setting=Base2026.04 | 78 | 0 | — | — | — | — | |
| LLaDA-1.5Attack=DIJA, Defence=DiffuGuard, Setting=Base2026.04 | 78 | 0 | — | — | — | — | |
| Dream-InstructAttack=DIJA, Defence=Self-rem., Setting=+SAD2026.04 | 78 | 0 | — | — | — | — | |
| Dream-InstructAttack=DIJA, Defence=None, Setting=+SAD2026.04 | 79 | 0 | — | — | — | — | |
| Dream-InstructAttack=DIJA, Defence=PPL, Setting=Base2026.04 | 80 | 0 | — | — | — | — | |
| Dream-InstructAttack=DIJA, Defence=DiffuGuard, Setting=Base2026.04 | 81 | 0 | — | — | — | — | |
| Dream-InstructAttack=DIJA, Defence=None, Setting=Base2026.04 | 84 | 0 | — | — | — | — | |
| Dream-InstructAttack=DIJA, Defence=PPL, Setting=+SAD2026.04 | 84 | 0 | — | — | — | — |