Jailbreak on AdvBench Ensemble configuration Average
1.43Harmfulness Score (HS)ArtPrompt
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ArtPromptDefense=self-reminder2024.12 | 1.43 | 0.05 | |
| SATA-ELPDefense=self-reminder2024.12 | 1.79 | 0.08 | |
| SATA-MLMDefense=self-reminder2024.12 | 2.01 | 0.17 | |
| ArtPromptDefense=rpo2024.12 | 2.97 | 0.37 | |
| ArtPromptDefense=windowed PPL-filter2024.12 | 3.03 | 0.32 | |
| ArtPromptDefense=None2024.12 | 3.54 | 0.53 | |
| SATA-MLMDefense=rpo2024.12 | 3.89 | 0.67 | |
| ArtPromptDefense=paraphrase2024.12 | 3.91 | 0.28 | |
| SATA-MLMDefense=paraphrase2024.12 | 3.95 | 0.58 | |
| SATA-ELPDefense=paraphrase2024.12 | 4.01 | 0.63 | |
| SATA-ELPDefense=rpo2024.12 | 4.09 | 0.66 | |
| SATA-MLMDefense=None2024.12 | 4.27 | 0.77 | |
| SATA-MLMDefense=windowed PPL-filter2024.12 | 4.29 | 0.77 | |
| SATA-ELPDefense=None2024.12 | 4.31 | 0.75 | |
| SATA-ELPDefense=windowed PPL-filter2024.12 | 4.35 | 0.75 |