JailbreakBench
Benchmarks
TaskDatasetSOTA resultTrendResults
JailbreakBench
100ASR
242
JailbreakBench
0ASR@10
132
JailbreakBench
0Harmbench ASR
88
JailbreakBench
0Attack Success Rate (ASR)
76
JailbreakBench
0Unsafe Rate
72
JailbreakBench (JBB)
0ASR
62
JailbreakBench (JBB) (test)
1.12ASR (Llama-Guard-3-8B)
56
JailbreakBench (test)
0Attack Success Rate (ASR)
54
JailbreakBench
2Attack Success Rate (ASR)
53
JailbreakBench
85ASR
42
JailbreakBench (JBB) (test)
98Attack Success Rate (ASR)
42
JailbreakBench
96Attack Success Rate (ASR)
40
JailbreakBench
97ASR1
39
JailbreakBench (original split)
95.15ASR@1
33
JailbreakBench 50% stratified per-category sample (48 requests)
0HB ASR
32
JailbreakBench
0ASR (GCG)
30
JailbreakBench
91ASR
27
JailbreakBench (out-of-domain)
73ASR (OM)
26
JailbreakBench (JBB)
0Thinking Collapse Rate
25
JailbreakBench single-turn
9ASR
21
JailbreakBench
0ASR (Detoxify)
20
JailbreakBench
70Rate of Response Safety
20
JailbreakBench
0.862AUROC
20
JailbreakBench
77Llama2 7B Attack Success Rate
18
JailbreakBench (test)
82ASR (Vicuna)
18