JailbreakV
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
JailBreakV_28K
88.32Attack Success Rate (ASR)
57
JailBreakV
0.72ASR
27
JailbreakV
2.81Latency (s)
25
JailbreakV-28K (test)
75.23ASR (None-Template)
25
JailbreakV-28K
99.12TCR
20
JailbreakV-28K v1 (test)
6.63ASR (Noise-T)
18
JailBreakV (test)
100Accuracy
17
JailbreakV_28K Text-based (test)
0FNR
16
JailbreakV_28K Image-based (test)
0.19FNR
16
JailbreakV_28K IND
0.19ASR
16
JailBreakV
99.61F1 Score
15
JailBreakV-28K (avg)
0.975JBV-R Score
15
JailBreakV
6.55Attack Success Rate (ASR)
14
JailBreakV-28K
78.9ASR (with SN)
11
JailbreakV
0ASR
10
JailbreakV-28K MLLM
0ASR
10
JailbreakV-28K LLM
1.46ASR
10
JailbreakV v1 (test)
63.8Compliance Rate
9
JailbreakV
99.69AUROC
9
JailbreakV-28K
8.4ASR (Noise, T)
6
JailbreakV-28K v1 (test)
38.16Defense Success Rate (Noise - T)
6
JailBreakV GPT4V
99.05AUROC
5
JailbreakV-28K
24.5Harmful Reasoning Ratio
3
JailBreakV (test)
23HPR
3