List your company

Jailbreak on AdvBench Ensemble configuration Llama-3-70B

4.6Harmfulness Score (HS)SATA-MLM
1.97922.65963.344.0204Dec 19, 2024

Evaluation results

MethodLinks
SATA-MLMDefense=None2024.124.60.82
SATA-MLMDefense=windowed PPL-filter2024.124.540.82
SATA-MLMDefense=paraphrase2024.124.260.66
SATA-MLMDefense=rpo2024.124.080.72
SATA-ELPDefense=windowed PPL-filter2024.124.080.64
ArtPromptDefense=paraphrase2024.123.940.34
SATA-ELPDefense=None2024.123.820.62
ArtPromptDefense=None2024.123.80.58
SATA-ELPDefense=rpo2024.123.70.58
SATA-ELPDefense=paraphrase2024.123.340.48
ArtPromptDefense=rpo2024.122.820.38
ArtPromptDefense=windowed PPL-filter2024.122.580.26
SATA-ELPDefense=self-reminder2024.122.540.16
ArtPromptDefense=self-reminder2024.122.160.16
SATA-MLMDefense=self-reminder2024.122.080.18