List your company

Jailbreak Evaluation on AdvBench Ensemble configuration Claude-v2

1.08Harmfulness Score (HS)ArtPrompt
0.94161.87582.813.7442Dec 19, 2024

Evaluation results

MethodLinks
ArtPromptDefense=self-reminder2024.121.080
SATA-ELPDefense=self-reminder2024.121.446
ArtPromptDefense=paraphrase2024.121.68
SATA-MLMDefense=self-reminder2024.121.668
ArtPromptDefense=rpo2024.122.2220
SATA-MLMDefense=paraphrase2024.123.3638
SATA-MLMDefense=rpo2024.123.3856
ArtPromptDefense=None2024.123.4452
ArtPromptDefense=windowed PPL-filter2024.123.6440
SATA-MLMDefense=windowed PPL-filter2024.123.866
SATA-MLMDefense=None2024.123.8668
SATA-ELPDefense=paraphrase2024.124.0664
SATA-ELPDefense=rpo2024.124.2872
SATA-ELPDefense=windowed PPL-filter2024.124.4884
SATA-ELPDefense=None2024.124.5486