List your company

Jailbreak on AdvBench Ensemble configuration GPT-4o

0Attack Success Rate (ASR)ArtPrompt
-3.9822.88549.7576.615Dec 19, 2024Feb 17, 2025Apr 19, 2025Jun 19, 2025Aug 18, 2025Oct 18, 2025Dec 18, 2025

Evaluation results

MethodLinks
ArtPromptDefense=self-reminder2024.1201.06
SATA-ELPDefense=self-reminder2024.1221.38
CipherChatlow_perplexity=false, single_turn_attack=true, require_human_strategies=true2025.1210—
GCGlow_perplexity=false, single_turn_attack=true, require_human_strategies=false2025.1212.5—
SATA-MLMDefense=self-reminder2024.12262.28
ArtPromptDefense=windowed PPL-filter2024.12302.88
PAIRlow_perplexity=true, single_turn_attack=true, require_human_strategies=true2025.1239—
ArtPromptDefense=paraphrase2024.12423.88
PAPlow_perplexity=true, single_turn_attack=true, require_human_strategies=true2025.1242—
ArtPromptDefense=None2024.12483.38
ArtPromptDefense=rpo2024.12523.88
SATA-ELPDefense=rpo2024.12684.28
SATA-MLMDefense=paraphrase2024.12704.22
Code Attacklow_perplexity=true, single_turn_attack=true, require_human_strategies=true2025.1270.5—
Bijectionlow_perplexity=false, single_turn_attack=true, require_human_strategies=false2025.1272.3—
SATA-MLMDefense=rpo2024.12744.2
SATA-ELPDefense=None2024.12784.56
SATA-ELPDefense=windowed PPL-filter2024.12784.48
SATA-ELPDefense=paraphrase2024.12784.62
SATA-MLMDefense=None2024.12824.36
SATA-MLMDefense=windowed PPL-filter2024.12844.54
ActorAttacklow_perplexity=true, single_turn_attack=false, require_human_strategies=false2025.1284.5—
BoN Attacklow_perplexity=false, single_turn_attack=true, require_human_strategies=false2025.1288.7—
J2 Attacklow_perplexity=true, single_turn_attack=false, require_human_strategies=true2025.1297.5—
Jailbreak-Zerolow_perplexity=true, single_turn_attack=true, require_human_strategies=false2025.1299.5—