Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

JailbreakBench dataset and benchmarks – Page 3 · SOTA2 Research

Research Datasets

JailbreakBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Jailbreak Defense

JailbreakBench Vicuna-13B

0ASR

7

Jailbreak Defense

JailbreakBench LLaMA-3-8B

0ASR

7

Harmfulness Evaluation

JailbreakBench

1.13Harmfulness Score

6

Prompt-level GCG attack

JailbreakBench (held-out prompts)

69ASR

6

Adversarial Detection

JailBreakBench (test)

10.5Inference Latency (ms)

5

Adversarial Robustness

JailbreakBench

99.4Score

5

Jailbreak Defense Efficiency and Effectiveness

JailbreakBench Summary Aggregates

1Avg ASR

5

Safety Alignment (Jailbreak Resistance)

JailbreakBench

74JailbreakBench Score

4

Jailbreak Attack

JailbreakBench 2024a

2.4Average Latency (s)

4

Prompt Injection Attack Robustness

JailbreakBench 2025 (test)

64ASP

3

Content Safety Detection

JailbreakBench

96.2F1 Score

2

Jailbreak Detection

JailbreakBench

99GCG Detection Rate (GCG DR)

2

Multi-turn Jailbreak

JailbreakBench

87Salami ASR (5-shot)

2

Out-of-distribution (OOD) Harmful Content Detection

JailbreakBench

0.962AUROC (Alpaca)

1

General Safety / Red-Teaming

JailbreakBench

—Primary metric

0

Page 3 of 3

Popular tasks

Jailbreak Attack Jailbreak Defense Jailbreaking Adversarial Attack Jailbreak Detection

Follow for updates

Join SOTA2 Contact