List your company
ResearchFormerly WizWand

Jailbreaking on AdvBench (test) (GPT-5 ASR & ACQ)

99ASR (GPT-4o)HMNS
37.84853.72469.685.476Apr 11, 2026
Updated 6mo ago

Evaluation results

MethodLinks
HMNSTarget LLM=LLaMA-3.1-70B, Zero-shot=true2026.0499951.8
HMNSTarget LLM=LLaMA-2-7B-Chat, Zero-shot=true2026.0498932
ArrAttackTarget LLM=LLaMA-3.1-70B, Zero-shot=true2026.0493897.4
ArrAttackTarget LLM=LLaMA-2-7B-Chat, Zero-shot=true2026.0492877.5
HMNSTarget LLM=Phi-3-Medium-14B (Instruct), Zero-shot=true2026.0492862
ArrAttackTarget LLM=Phi-3-Medium-14B (Instruct), Zero-shot=true2026.0486808.2
TempestTarget LLM=LLaMA-3.1-70B, Zero-shot=true2026.0485.380.19.1
TempestTarget LLM=LLaMA-2-7B-Chat, Zero-shot=true2026.0484.178.49.4
TempestTarget LLM=Phi-3-Medium-14B (Instruct), Zero-shot=true2026.0482.175.89.7
PrisonBreakTarget LLM=LLaMA-3.1-70B, Zero-shot=true2026.0478.472.611.5
PrisonBreakTarget LLM=LLaMA-2-7B-Chat, Zero-shot=true2026.0477.371.211.7
AutoDANTarget LLM=LLaMA-3.1-70B, Zero-shot=true2026.047467.912.4
PrisonBreakTarget LLM=Phi-3-Medium-14B (Instruct), Zero-shot=true2026.0473.667.112.5
AutoDANTarget LLM=LLaMA-2-7B-Chat, Zero-shot=true2026.0472.666.212.8
MasterKeyTarget LLM=LLaMA-3.1-70B, Zero-shot=true2026.0471.665.710.4
MasterKeyTarget LLM=LLaMA-2-7B-Chat, Zero-shot=true2026.0470.464.310.5
ADCTarget LLM=LLaMA-3.1-70B, Zero-shot=true2026.0470.164.29.6
ADCTarget LLM=LLaMA-2-7B-Chat, Zero-shot=true2026.0468.262.49.9
Many-shot JB (MSJ)Target LLM=LLaMA-3.1-70B, Zero-shot=true2026.0466.960.910.6
AutoDANTarget LLM=Phi-3-Medium-14B (Instruct), Zero-shot=true2026.0465.158.813.6
Many-shot JB (MSJ)Target LLM=LLaMA-2-7B-Chat, Zero-shot=true2026.0464.858.910.9
MasterKeyTarget LLM=Phi-3-Medium-14B (Instruct), Zero-shot=true2026.0462.756.311.3
ADCTarget LLM=Phi-3-Medium-14B (Instruct), Zero-shot=true2026.0461.355.410.8
Many-shot JB (MSJ)Target LLM=Phi-3-Medium-14B (Instruct), Zero-shot=true2026.0458.452.611.9
Foot-In-The-Door (FITD)Target LLM=LLaMA-3.1-70B, Zero-shot=true2026.0446.540.815.7
Foot-In-The-Door (FITD)Target LLM=LLaMA-2-7B-Chat, Zero-shot=true2026.04443816.2
Foot-In-The-Door (FITD)Target LLM=Phi-3-Medium-14B (Instruct), Zero-shot=true2026.0440.234.517