Jailbreak Robustness on StrongREJECT
0Mean Harmful ScoreLLaDA-Instruct
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LLaDA-InstructAttack=Zero-shot, Defense=Self-rem.2026.04 | 0 | — | — | — | — | — | — | — | — | — | 96.5 | |
| LLaDA-1.5Attack=Zero-shot, Defense=None2026.04 | 0 | — | — | — | — | — | — | — | — | — | 92.7 | |
| LLaDA-1.5Attack=Zero-shot, Defense=Self-rem.2026.04 | 0 | — | — | — | — | — | — | — | — | — | 92.7 | |
| Dream-InstructAttack=Zero-shot, Defense=None, SAD-Augmented=true2026.04 | 0 | — | — | — | — | — | — | — | — | — | 47.2 | |
| Dream-InstructAttack=Zero-shot, Defense=Self-rem.2026.04 | 0 | — | — | — | — | — | — | — | — | — | 84.3 | |
| Dream-InstructAttack=Zero-shot, Defense=DiffuGuard2026.04 | 0 | — | — | — | — | — | — | — | — | — | 84.3 | |
| Dream-InstructAttack=Zero-shot, Defense=DiffuGuard, SAD-Augmented=true2026.04 | 0 | — | — | — | — | — | — | — | — | — | 47.2 | |
| LLaDA-1.5Attack=Zero-shot, Defense=PPL2026.04 | 0.3 | — | — | — | — | — | — | — | — | — | 92.7 | |
| Dream-InstructAttack=Zero-shot, Defense=PPL, SAD-Augmented=true2026.04 | 0.3 | — | — | — | — | — | — | — | — | — | 47.2 | |
| Dream-InstructAttack=Zero-shot, Defense=Self-rem., SAD-Augmented=true2026.04 | 0.3 | — | — | — | — | — | — | — | — | — | 47.2 | |
| LLaDA-1.5Attack=Zero-shot, Defense=DiffuGuard2026.04 | 0.6 | — | — | — | — | — | — | — | — | — | 92.7 | |
| Dream-InstructAttack=Zero-shot, Defense=None2026.04 | 0.6 | — | — | — | — | — | — | — | — | — | 84.3 | |
| Dream-InstructAttack=Zero-shot, Defense=PPL2026.04 | 0.6 | — | — | — | — | — | — | — | — | — | 84.3 | |
| LLaDA-InstructAttack=Zero-shot, Defense=PPL2026.04 | 1.3 | — | — | — | — | — | — | — | — | — | 96.5 | |
| LLaDA-InstructAttack=Zero-shot, Defense=DiffuGuard2026.04 | 1.3 | — | — | — | — | — | — | — | — | — | 96.5 | |
| LLaDA-InstructAttack=Zero-shot, Defense=None2026.04 | 1.6 | — | — | — | — | — | — | — | — | — | 96.5 | |
| LLaDA-InstructAttack=Zero-shot, Defense=None, SAD-Augmented=true2026.04 | 3.2 | — | — | — | — | — | — | — | — | — | 8.3 | |
| LLaDA-InstructAttack=Zero-shot, Defense=PPL, SAD-Augmented=true2026.04 | 3.2 | — | — | — | — | — | — | — | — | — | 8.3 | |
| LLaDA-InstructAttack=Zero-shot, Defense=Self-rem., SAD-Augmented=true2026.04 | 3.5 | — | — | — | — | — | — | — | — | — | 8.3 | |
| LLaDA-1.5Attack=Zero-shot, Defense=PPL, SAD-Augmented=true2026.04 | 3.5 | — | — | — | — | — | — | — | — | — | 8 | |
| LLaDA-InstructAttack=Zero-shot, Defense=DiffuGuard, SAD-Augmented=true2026.04 | 3.8 | — | — | — | — | — | — | — | — | — | 8.3 | |
| LLaDA-1.5Attack=Zero-shot, Defense=Self-rem., SAD-Augmented=true2026.04 | 4.5 | — | — | — | — | — | — | — | — | — | 8 | |
| LLaDA-1.5Attack=Zero-shot, Defense=DiffuGuard, SAD-Augmented=true2026.04 | 4.5 | — | — | — | — | — | — | — | — | — | 8 | |
| LLaDA-1.5Attack=Zero-shot, Defense=None, SAD-Augmented=true2026.04 | 4.8 | — | — | — | — | — | — | — | — | — | 8 | |
| sonnet-4-thinking2025.10 | 8 | — | 1 | 11 | 8 | 7 | 20 | 1 | — | — | — | |
| ASCoTBase Model=LLaMA-3.1-8B, Access=open2025.10 | 8 | — | 0 | 11 | 3 | 10 | 12 | 12 | — | — | — | |
| LLaDA-1.5Attack=PAD, Defense=Self-rem., SAD-Augmented=true2026.04 | 13.1 | — | — | — | — | — | — | — | — | — | 0.6 | |
| LLaDA-1.5Attack=PAD, Defense=Self-rem.2026.04 | 17.6 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-1.5Attack=DIJA, Defense=PPL2026.04 | 20.4 | — | — | — | — | — | — | — | — | — | 0.3 | |
| LLaDA-1.5Attack=DIJA, Defense=PPL, SAD-Augmented=true2026.04 | 20.4 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-InstructAttack=PAD, Defense=Self-rem.2026.04 | 24.9 | — | — | — | — | — | — | — | — | — | 0.3 | |
| LLaDA-InstructAttack=PAD, Defense=Self-rem., SAD-Augmented=true2026.04 | 24.9 | — | — | — | — | — | — | — | — | — | 3.5 | |
| o4-mini2025.10 | 26 | — | 1 | 36 | 19 | 13 | 70 | 19 | — | — | — | |
| Dream-InstructAttack=PAD, Defense=Self-rem.2026.04 | 30.4 | — | — | — | — | — | — | — | — | — | 19.2 | |
| Dream-InstructAttack=PAD, Defense=Self-rem., SAD-Augmented=true2026.04 | 32.9 | — | — | — | — | — | — | — | — | — | 16.6 | |
| Dream-InstructAttack=PAD, Defense=DiffuGuard, SAD-Augmented=true2026.04 | 42.5 | — | — | — | — | — | — | — | — | — | 16.6 | |
| Dream-InstructAttack=PAD, Defense=PPL, SAD-Augmented=true2026.04 | 43.5 | — | — | — | — | — | — | — | — | — | 16.6 | |
| Dream-InstructAttack=PAD, Defense=None, SAD-Augmented=true2026.04 | 44.7 | — | — | — | — | — | — | — | — | — | 16.6 | |
| Dream-InstructAttack=PAD, Defense=None2026.04 | 46.3 | — | — | — | — | — | — | — | — | — | 19.2 | |
| Dream-InstructAttack=PAD, Defense=PPL2026.04 | 46.3 | — | — | — | — | — | — | — | — | — | 19.2 | |
| Dream-InstructAttack=PAD, Defense=DiffuGuard2026.04 | 51.1 | — | — | — | — | — | — | — | — | — | 19.2 | |
| LLaDA-1.5Attack=PAD, Defense=DiffuGuard, SAD-Augmented=true2026.04 | 55.9 | — | — | — | — | — | — | — | — | — | 0.6 | |
| LLaDA-1.5Attack=PAD, Defense=None, SAD-Augmented=true2026.04 | 56.5 | — | — | — | — | — | — | — | — | — | 0.6 | |
| LLaDA-1.5Attack=PAD, Defense=PPL, SAD-Augmented=true2026.04 | 57.8 | — | — | — | — | — | — | — | — | — | 0.6 | |
| LLaDA-1.5Attack=PAD, Defense=PPL2026.04 | 62 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-1.5Attack=PAD, Defense=DiffuGuard2026.04 | 63.3 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-1.5Attack=PAD, Defense=None2026.04 | 64.2 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-InstructAttack=PAD, Defense=None, SAD-Augmented=true2026.04 | 65.5 | — | — | — | — | — | — | — | — | — | 3.5 | |
| LLaDA-InstructAttack=PAD, Defense=DiffuGuard, SAD-Augmented=true2026.04 | 68.4 | — | — | — | — | — | — | — | — | — | 3.5 | |
| LLaDA-InstructAttack=DIJA, Defense=Self-rem., SAD-Augmented=true2026.04 | 69 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-InstructAttack=DIJA, Defense=DiffuGuard2026.04 | 69.3 | — | — | — | — | — | — | — | — | — | 0.3 | |
| LLaDA-1.5Attack=DIJA, Defense=DiffuGuard, SAD-Augmented=true2026.04 | 70.3 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-1.5Attack=DIJA, Defense=Self-rem., SAD-Augmented=true2026.04 | 70.6 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-1.5Attack=DIJA, Defense=None2026.04 | 70.9 | — | — | — | — | — | — | — | — | — | 0.3 | |
| LLaDA-InstructAttack=PAD, Defense=DiffuGuard2026.04 | 71.2 | — | — | — | — | — | — | — | — | — | 0.3 | |
| LLaDA-1.5Attack=DIJA, Defense=Self-rem.2026.04 | 71.2 | — | — | — | — | — | — | — | — | — | 0.3 | |
| LLaDA-1.5Attack=DIJA, Defense=None, SAD-Augmented=true2026.04 | 71.6 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-1.5Attack=DIJA, Defense=DiffuGuard2026.04 | 71.6 | — | — | — | — | — | — | — | — | — | 0.3 | |
| LLaDA-InstructAttack=DIJA, Defense=DiffuGuard, SAD-Augmented=true2026.04 | 71.9 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-InstructAttack=PAD, Defense=None2026.04 | 71.9 | — | — | — | — | — | — | — | — | — | 0.3 | |
| LLaDA-InstructAttack=DIJA, Defense=None2026.04 | 72.8 | — | — | — | — | — | — | — | — | — | 0.3 | |
| LLaDA-InstructAttack=DIJA, Defense=None, SAD-Augmented=true2026.04 | 72.8 | — | — | — | — | — | — | — | — | — | 0 | |
| Dream-InstructAttack=DIJA, Defense=Self-rem.2026.04 | 72.8 | — | — | — | — | — | — | — | — | — | 0 | |
| Dream-InstructAttack=DIJA, Defense=Self-rem., SAD-Augmented=true2026.04 | 73.2 | — | — | — | — | — | — | — | — | — | 0 | |
| Dream-InstructAttack=DIJA, Defense=DiffuGuard, SAD-Augmented=true2026.04 | 73.2 | — | — | — | — | — | — | — | — | — | 0 | |
| Dream-InstructAttack=DIJA, Defense=None, SAD-Augmented=true2026.04 | 73.5 | — | — | — | — | — | — | — | — | — | 0 | |
| Dream-InstructAttack=DIJA, Defense=None2026.04 | 74.1 | — | — | — | — | — | — | — | — | — | 0 | |
| Dream-InstructAttack=DIJA, Defense=PPL, SAD-Augmented=true2026.04 | 74.1 | — | — | — | — | — | — | — | — | — | 0 | |
| Dream-InstructAttack=DIJA, Defense=DiffuGuard2026.04 | 75.1 | — | — | — | — | — | — | — | — | — | 0 | |
| LLaDA-InstructAttack=DIJA, Defense=Self-rem.2026.04 | 76 | — | — | — | — | — | — | — | — | — | 0.3 | |
| Dream-InstructAttack=DIJA, Defense=PPL2026.04 | 78.6 | — | — | — | — | — | — | — | — | — | 0 | |
| Base2025.09 | — | 63.02 | — | 35.14 | 64.86 | — | — | — | 99.68 | 52.4 | — | |
| DPO_WhispererAlignment=DPO, Data Recipe=ear-whisperer, Base Model=SFT_DB2025.05 | — | 94.91 | — | — | — | — | — | — | — | — | — | |
| gpt-oss-safeguard-20bMode=Post-hoc2025.09 | — | 88.26 | — | 71.25 | 82.75 | — | — | — | 99.68 | 99.36 | — | |
| LlamaGuardMode=Post-hoc2025.09 | — | 78.92 | — | 46.33 | 71.57 | — | — | — | 100 | 97.76 | — | |
| Mixtral (Base)LLM=Mixtral, SFT Status=None2025.05 | — | 51.09 | — | — | — | — | — | — | — | — | — | |
| Mixtral (SFT_DB)LLM=Mixtral, SFT Status=SFT on AIDSAFE-generated CoTs and responses2025.05 | — | 94.04 | — | — | — | — | — | — | — | — | — | |
| Mixtral (SFT_OG)LLM=Mixtral, SFT Status=SFT on original response data without CoTs2025.05 | — | 67.01 | — | — | — | — | — | — | — | — | — | |
| Qwen (Base)LLM=Qwen, SFT Status=None2025.05 | — | 72.84 | — | — | — | — | — | — | — | — | — | |
| Qwen (SFT_DB)LLM=Qwen, SFT Status=SFT on AIDSAFE-generated CoTs and responses2025.05 | — | 95.39 | — | — | — | — | — | — | — | — | — | |
| Qwen (SFT_OG)LLM=Qwen, SFT Status=SFT on original response data without CoTs2025.05 | — | 59.48 | — | — | — | — | — | — | — | — | — | |
| ReSA-SFTTraining=Supervised Fine-Tuning2025.09 | — | 96.33 | — | 89.78 | 96.81 | — | — | — | 99.36 | 99.36 | — | |
| SFT_DBTraining=Supervised Fine-Tuning, Data Generation=AIDSAFE2025.05 | — | 94.04 | — | — | — | — | — | — | — | — | — |