Unsafe Robustness on AdvBench
0Unsafe RateLLaDA-Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLaDA-InstructAttack=Zero-shot, Defense=None2026.04 | 0 | 99.6 | |
| LLaDA-InstructAttack=Zero-shot, Defense=PPL2026.04 | 0 | — | |
| LLaDA-InstructAttack=Zero-shot, Defense=Self-rem.2026.04 | 0 | — | |
| LLaDA-InstructAttack=Zero-shot, Defense=DiffuGuard2026.04 | 0 | — | |
| LLaDA-InstructAttack=DIJA, Defense=None2026.04 | 0 | 99.4 | |
| LLaDA-Instruct + SADAttack=DIJA, Defense=None2026.04 | 0 | 33.9 | |
| LLaDA-InstructAttack=DIJA, Defense=PPL2026.04 | 0 | — | |
| LLaDA-Instruct + SADAttack=DIJA, Defense=PPL2026.04 | 0 | — | |
| LLaDA-InstructAttack=DIJA, Defense=Self-rem.2026.04 | 0 | — | |
| LLaDA-Instruct + SADAttack=DIJA, Defense=Self-rem.2026.04 | 0 | — | |
| LLaDA-InstructAttack=DIJA, Defense=DiffuGuard2026.04 | 0 | — | |
| LLaDA-Instruct + SADAttack=DIJA, Defense=DiffuGuard2026.04 | 0 | — | |
| LLaDA-InstructAttack=PAD, Defense=PPL2026.04 | 0 | — | |
| LLaDA-Instruct + SADAttack=PAD, Defense=PPL2026.04 | 0 | — | |
| LLaDA-1.5Attack=Zero-shot, Defense=None2026.04 | 0 | 99.6 | |
| LLaDA-1.5Attack=Zero-shot, Defense=PPL2026.04 | 0 | — | |
| LLaDA-1.5Attack=Zero-shot, Defense=Self-rem.2026.04 | 0 | — | |
| LLaDA-1.5Attack=Zero-shot, Defense=DiffuGuard2026.04 | 0 | — | |
| LLaDA-1.5Attack=DIJA, Defense=None2026.04 | 0 | 99.2 | |
| LLaDA-1.5 + SADAttack=DIJA, Defense=None2026.04 | 0 | 39.6 | |
| LLaDA-1.5Attack=DIJA, Defense=PPL2026.04 | 0 | — | |
| LLaDA-1.5 + SADAttack=DIJA, Defense=PPL2026.04 | 0 | — | |
| LLaDA-1.5Attack=DIJA, Defense=Self-rem.2026.04 | 0 | — | |
| LLaDA-1.5 + SADAttack=DIJA, Defense=Self-rem.2026.04 | 0 | — | |
| LLaDA-1.5Attack=DIJA, Defense=DiffuGuard2026.04 | 0 | — | |
| LLaDA-1.5 + SADAttack=DIJA, Defense=DiffuGuard2026.04 | 0 | — | |
| Dream-InstructAttack=Zero-shot, Defense=None2026.04 | 0 | 90.6 | |
| Dream-Instruct + SADAttack=Zero-shot, Defense=None2026.04 | 0 | 47.1 | |
| Dream-Instruct + SADAttack=Zero-shot, Defense=PPL2026.04 | 0 | — | |
| Dream-InstructAttack=Zero-shot, Defense=Self-rem.2026.04 | 0 | — | |
| Dream-Instruct + SADAttack=Zero-shot, Defense=DiffuGuard2026.04 | 0 | — | |
| Dream-InstructAttack=Zero-shot, Defense=DiffuGuard2026.04 | 0.2 | — | |
| Dream-InstructAttack=Zero-shot, Defense=PPL2026.04 | 0.4 | — | |
| Dream-Instruct + SADAttack=Zero-shot, Defense=Self-rem.2026.04 | 0.4 | — | |
| LLaDA-Instruct + SADAttack=Zero-shot, Defense=None2026.04 | 4 | 3.5 | |
| LLaDA-Instruct + SADAttack=Zero-shot, Defense=DiffuGuard2026.04 | 4.2 | — | |
| LLaDA-Instruct + SADAttack=Zero-shot, Defense=PPL2026.04 | 4.4 | — | |
| LLaDA-1.5 + SADAttack=Zero-shot, Defense=None2026.04 | 4.6 | 4 | |
| LLaDA-1.5 + SADAttack=Zero-shot, Defense=PPL2026.04 | 4.6 | — | |
| LLaDA-1.5 + SADAttack=Zero-shot, Defense=DiffuGuard2026.04 | 4.6 | — | |
| LLaDA-1.5 + SADAttack=Zero-shot, Defense=Self-rem.2026.04 | 5 | — | |
| LLaDA-Instruct + SADAttack=Zero-shot, Defense=Self-rem.2026.04 | 6 | — | |
| Dream-InstructAttack=PAD, Defense=Self-rem.2026.04 | 13.5 | — | |
| Dream-Instruct + SADAttack=DIJA, Defense=Self-rem.2026.04 | 13.7 | — | |
| Dream-Instruct + SADAttack=PAD, Defense=Self-rem.2026.04 | 14 | — | |
| LLaDA-1.5 + SADAttack=PAD, Defense=Self-rem.2026.04 | 14.8 | — | |
| Dream-InstructAttack=DIJA, Defense=Self-rem.2026.04 | 17.7 | — | |
| LLaDA-1.5Attack=PAD, Defense=Self-rem.2026.04 | 20 | — | |
| Dream-Instruct + SADAttack=DIJA, Defense=None2026.04 | 24.6 | 45.4 | |
| Dream-Instruct + SADAttack=DIJA, Defense=PPL2026.04 | 28.1 | — | |
| Dream-Instruct + SADAttack=DIJA, Defense=DiffuGuard2026.04 | 31.5 | — | |
| Dream-Instruct + SADAttack=PAD, Defense=DiffuGuard2026.04 | 31.7 | — | |
| Dream-InstructAttack=PAD, Defense=None2026.04 | 32.5 | 57.9 | |
| Dream-Instruct + SADAttack=PAD, Defense=None2026.04 | 32.7 | 59 | |
| Dream-InstructAttack=PAD, Defense=DiffuGuard2026.04 | 34 | — | |
| LLaDA-Instruct + SADAttack=PAD, Defense=Self-rem.2026.04 | 35.4 | — | |
| Dream-Instruct + SADAttack=PAD, Defense=PPL2026.04 | 35.8 | — | |
| Dream-InstructAttack=PAD, Defense=PPL2026.04 | 36.3 | — | |
| LLaDA-InstructAttack=PAD, Defense=Self-rem.2026.04 | 39.4 | — | |
| Dream-InstructAttack=DIJA, Defense=None2026.04 | 44 | 37.3 | |
| Dream-InstructAttack=DIJA, Defense=PPL2026.04 | 44.8 | — | |
| Dream-InstructAttack=DIJA, Defense=DiffuGuard2026.04 | 46.9 | — | |
| LLaDA-1.5 + SADAttack=PAD, Defense=DiffuGuard2026.04 | 61.9 | — | |
| LLaDA-1.5 + SADAttack=PAD, Defense=None2026.04 | 62.1 | 0.2 | |
| LLaDA-1.5 + SADAttack=PAD, Defense=PPL2026.04 | 63.8 | — | |
| LLaDA-1.5Attack=PAD, Defense=DiffuGuard2026.04 | 71.2 | — | |
| LLaDA-1.5Attack=PAD, Defense=None2026.04 | 71.9 | 0 | |
| LLaDA-1.5Attack=PAD, Defense=PPL2026.04 | 72.7 | — | |
| LLaDA-Instruct + SADAttack=PAD, Defense=None2026.04 | 76.2 | 0.2 | |
| LLaDA-Instruct + SADAttack=PAD, Defense=DiffuGuard2026.04 | 76.7 | — | |
| LLaDA-InstructAttack=PAD, Defense=None2026.04 | 82.3 | 0.2 | |
| LLaDA-InstructAttack=PAD, Defense=DiffuGuard2026.04 | 84.4 | — |