Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Jailbreak research benchmarks – Page 2 · SOTA2 Research

Jailbreak

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

AdvBench Gemini-2.5-Flash

71.3ASR

7

May 20, 2026

AdvBench target: o4-mini

64ASR (o4-mini)

7

May 20, 2026

WildBreak (held-out)

25ASR

5

Jun 5, 2026

GPT 4.1 8 July 2025 release

99.8ASR

5

Mar 17, 2026

GPT-4o 29 May 2025 release

98.46ASR

5

Mar 17, 2026

Direct Prompting

0ASR (%)

5

Feb 26, 2026

18ASR

3

Apr 14, 2026

94Refusal Rate (AdvBench)

3

Mar 4, 2026

AdvBench Multiple-choice format (full)

99Safe Option Probability

3

Mar 4, 2026

WildJailbreak Forbidden Questions (Overall)

92.1ASR

2

Mar 12, 2026

AdvBench RPO defense (full)

92ASR

2

Mar 4, 2026

AdvBench PAT defense (full)

80ASR

2

Mar 4, 2026

Page 2 of 2

Popular datasets

AdvBench HarmBench Wildjailbreak JBB-Behaviors JailbreakBench

Follow for updates

Join SOTA2 Contact