List your company

Jailbreak on AdvBench Ensemble configuration Average

1.43Harmfulness Score (HS)ArtPrompt
1.31322.10162.893.6784Dec 19, 2024

Evaluation results

MethodLinks
ArtPromptDefense=self-reminder2024.121.430.05
SATA-ELPDefense=self-reminder2024.121.790.08
SATA-MLMDefense=self-reminder2024.122.010.17
ArtPromptDefense=rpo2024.122.970.37
ArtPromptDefense=windowed PPL-filter2024.123.030.32
ArtPromptDefense=None2024.123.540.53
SATA-MLMDefense=rpo2024.123.890.67
ArtPromptDefense=paraphrase2024.123.910.28
SATA-MLMDefense=paraphrase2024.123.950.58
SATA-ELPDefense=paraphrase2024.124.010.63
SATA-ELPDefense=rpo2024.124.090.66
SATA-MLMDefense=None2024.124.270.77
SATA-MLMDefense=windowed PPL-filter2024.124.290.77
SATA-ELPDefense=None2024.124.310.75
SATA-ELPDefense=windowed PPL-filter2024.124.350.75