Unsafe Robustness on HarmBench
1Unsafe RateDream-Instruct
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Dream-InstructAttack=Zero-shot, Defense=Self-rem., Configuration=Base2026.04 | 1 | 73 | |
| Dream-Instruct + SADAttack=Zero-shot, Defense=Self-rem., Configuration=+SAD2026.04 | 1.2 | 40.5 | |
| LLaDA-InstructAttack=Zero-shot, Defense=Self-rem., Configuration=Base2026.04 | 1.8 | 67 | |
| Dream-InstructAttack=Zero-shot, Defense=None, Configuration=Base2026.04 | 1.8 | 73 | |
| LLaDA-InstructAttack=Zero-shot, Defense=None, Configuration=Base2026.04 | 2.8 | 67 | |
| Dream-Instruct + SADAttack=Zero-shot, Defense=None, Configuration=+SAD2026.04 | 3 | 40.5 | |
| LLaDA-InstructAttack=Zero-shot, Defense=PPL, Configuration=Base2026.04 | 3.8 | 67 | |
| Dream-InstructAttack=Zero-shot, Defense=PPL, Configuration=Base2026.04 | 4 | 73 | |
| Dream-Instruct + SADAttack=Zero-shot, Defense=PPL, Configuration=+SAD2026.04 | 4.2 | 40.5 | |
| Dream-Instruct + SADAttack=Zero-shot, Defense=DiffuGuard, Configuration=+SAD2026.04 | 4.2 | 40.5 | |
| LLaDA-InstructAttack=Zero-shot, Defense=DiffuGuard, Configuration=Base2026.04 | 4.5 | 67 | |
| Dream-InstructAttack=Zero-shot, Defense=DiffuGuard, Configuration=Base2026.04 | 5 | 73 | |
| LLaDA-1.5Attack=Zero-shot, Defense=Self-rem., Configuration=Base2026.04 | 6.2 | 69.2 | |
| LLaDA-1.5Attack=Zero-shot, Defense=DiffuGuard, Configuration=Base2026.04 | 7.2 | 69.2 | |
| LLaDA-1.5Attack=Zero-shot, Defense=None, Configuration=Base2026.04 | 7.5 | 69.2 | |
| LLaDA-1.5Attack=Zero-shot, Defense=PPL, Configuration=Base2026.04 | 7.5 | 69.2 | |
| LLaDA-1.5 + SADAttack=Zero-shot, Defense=PPL, Configuration=+SAD2026.04 | 8.5 | 5 | |
| LLaDA-Instruct + SADAttack=Zero-shot, Defense=Self-rem., Configuration=+SAD2026.04 | 9 | 6 | |
| LLaDA-1.5 + SADAttack=Zero-shot, Defense=None, Configuration=+SAD2026.04 | 9.2 | 5 | |
| LLaDA-1.5Attack=DIJA, Defense=PPL, Configuration=Base2026.04 | 9.8 | 0.2 | |
| LLaDA-Instruct + SADAttack=Zero-shot, Defense=None, Configuration=+SAD2026.04 | 10.5 | 6 | |
| LLaDA-Instruct + SADAttack=Zero-shot, Defense=PPL, Configuration=+SAD2026.04 | 10.5 | 6 | |
| LLaDA-1.5 + SADAttack=DIJA, Defense=PPL, Configuration=+SAD2026.04 | 10.5 | 0 | |
| LLaDA-1.5 + SADAttack=Zero-shot, Defense=DiffuGuard, Configuration=+SAD2026.04 | 11 | 5 | |
| LLaDA-Instruct + SADAttack=Zero-shot, Defense=DiffuGuard, Configuration=+SAD2026.04 | 11.8 | 6 | |
| LLaDA-InstructAttack=DIJA, Defense=PPL, Configuration=Base2026.04 | 11.8 | 0.2 | |
| LLaDA-1.5 + SADAttack=Zero-shot, Defense=Self-rem., Configuration=+SAD2026.04 | 11.8 | 5 | |
| LLaDA-Instruct + SADAttack=DIJA, Defense=PPL, Configuration=+SAD2026.04 | 12.9 | 0 | |
| Dream-Instruct + SADAttack=PAD, Defense=Self-rem., Configuration=+SAD2026.04 | 19.5 | 35.5 | |
| Dream-InstructAttack=PAD, Defense=Self-rem., Configuration=Base2026.04 | 25.8 | 39 | |
| Dream-InstructAttack=PAD, Defense=None, Configuration=Base2026.04 | 34 | 39 | |
| Dream-Instruct + SADAttack=PAD, Defense=DiffuGuard, Configuration=+SAD2026.04 | 34.5 | 35.5 | |
| Dream-Instruct + SADAttack=PAD, Defense=PPL, Configuration=+SAD2026.04 | 35.5 | 35.5 | |
| Dream-Instruct + SADAttack=PAD, Defense=None, Configuration=+SAD2026.04 | 36 | 35.5 | |
| Dream-InstructAttack=PAD, Defense=PPL, Configuration=Base2026.04 | 37.2 | 39 | |
| Dream-InstructAttack=PAD, Defense=DiffuGuard, Configuration=Base2026.04 | 38 | 39 | |
| LLaDA-1.5 + SADAttack=PAD, Defense=Self-rem., Configuration=+SAD2026.04 | 46.5 | 0.5 | |
| LLaDA-1.5Attack=PAD, Defense=Self-rem., Configuration=Base2026.04 | 47 | 0 | |
| LLaDA-InstructAttack=PAD, Defense=Self-rem., Configuration=Base2026.04 | 54.8 | 0 | |
| LLaDA-1.5Attack=DIJA, Defense=None, Configuration=Base2026.04 | 54.8 | 0.2 | |
| LLaDA-Instruct + SADAttack=PAD, Defense=Self-rem., Configuration=+SAD2026.04 | 56.5 | 0.8 | |
| LLaDA-1.5Attack=DIJA, Defense=Self-rem., Configuration=Base2026.04 | 57 | 0.2 | |
| LLaDA-InstructAttack=DIJA, Defense=DiffuGuard, Configuration=Base2026.04 | 57.5 | 0.2 | |
| Dream-InstructAttack=DIJA, Defense=DiffuGuard, Configuration=Base2026.04 | 57.8 | 0 | |
| LLaDA-InstructAttack=DIJA, Defense=None, Configuration=Base2026.04 | 58 | 0.2 | |
| LLaDA-InstructAttack=DIJA, Defense=Self-rem., Configuration=Base2026.04 | 58 | 0.2 | |
| LLaDA-1.5 + SADAttack=DIJA, Defense=None, Configuration=+SAD2026.04 | 58 | 0 | |
| Dream-Instruct + SADAttack=DIJA, Defense=Self-rem., Configuration=+SAD2026.04 | 58.2 | 0 | |
| LLaDA-1.5 + SADAttack=DIJA, Defense=DiffuGuard, Configuration=+SAD2026.04 | 58.5 | 0 | |
| Dream-Instruct + SADAttack=DIJA, Defense=DiffuGuard, Configuration=+SAD2026.04 | 58.5 | 0 | |
| LLaDA-1.5 + SADAttack=DIJA, Defense=Self-rem., Configuration=+SAD2026.04 | 58.8 | 0 | |
| LLaDA-1.5Attack=DIJA, Defense=DiffuGuard, Configuration=Base2026.04 | 58.8 | 0.2 | |
| Dream-InstructAttack=DIJA, Defense=Self-rem., Configuration=Base2026.04 | 58.8 | 0 | |
| LLaDA-Instruct + SADAttack=DIJA, Defense=Self-rem., Configuration=+SAD2026.04 | 59.8 | 0 | |
| Dream-InstructAttack=DIJA, Defense=PPL, Configuration=Base2026.04 | 59.8 | 0 | |
| LLaDA-Instruct + SADAttack=DIJA, Defense=DiffuGuard, Configuration=+SAD2026.04 | 60 | 0 | |
| Dream-Instruct + SADAttack=DIJA, Defense=PPL, Configuration=+SAD2026.04 | 60.2 | 0 | |
| LLaDA-Instruct + SADAttack=DIJA, Defense=None, Configuration=+SAD2026.04 | 60.5 | 0 | |
| Dream-Instruct + SADAttack=DIJA, Defense=None, Configuration=+SAD2026.04 | 60.5 | 0 | |
| Dream-InstructAttack=DIJA, Defense=None, Configuration=Base2026.04 | 62 | 0 | |
| LLaDA-1.5 + SADAttack=PAD, Defense=PPL, Configuration=+SAD2026.04 | 68.2 | 0.5 | |
| LLaDA-1.5 + SADAttack=PAD, Defense=DiffuGuard, Configuration=+SAD2026.04 | 69.8 | 0.5 | |
| LLaDA-Instruct + SADAttack=PAD, Defense=None, Configuration=+SAD2026.04 | 70.5 | 0.8 | |
| LLaDA-1.5 + SADAttack=PAD, Defense=None, Configuration=+SAD2026.04 | 70.5 | 0.5 | |
| LLaDA-1.5Attack=PAD, Defense=PPL, Configuration=Base2026.04 | 71.5 | 0 | |
| LLaDA-Instruct + SADAttack=PAD, Defense=DiffuGuard, Configuration=+SAD2026.04 | 72.5 | 0.8 | |
| LLaDA-1.5Attack=PAD, Defense=DiffuGuard, Configuration=Base2026.04 | 74.8 | 0 | |
| LLaDA-1.5Attack=PAD, Defense=None, Configuration=Base2026.04 | 75.5 | 0 | |
| LLaDA-InstructAttack=PAD, Defense=DiffuGuard, Configuration=Base2026.04 | 77.5 | 0 | |
| LLaDA-InstructAttack=PAD, Defense=None, Configuration=Base2026.04 | 78.5 | 0 | |
| LLaDA-Instruct + SADAttack=PAD, Defense=PPL, Configuration=+SAD2026.04 | 79.5 | 0.8 | |
| LLaDA-InstructAttack=PAD, Defense=PPL, Configuration=Base2026.04 | 80.2 | 0 |