Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

AdvBench dataset and benchmarks – Page 9 · SOTA2 Research

Research Datasets

AdvBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Jailbreak Success Rate

advbench

3.8Raw Jailbreak Success Rate

3

Response Repetition Rate Evaluation

AdvBench Adv (test)

43.5MS_R

3

Safety Evaluation

AdvBench (full)

100Good Bot Rate

3

AdvBench

94Refusal Rate (AdvBench)

3

AdvBench Multiple-choice format (full)

99Safe Option Probability

3

Priming Attack Robustness

AdvBench PAD (test)

14ASR (GPT-4o)

3

Jailbreak Attack

AdvBench Vicuna to gpt-3.5-turbo (transfer)

90ASR (Refusal Matching)

3

Response Generation

AdvBench

0.95Win Rate

3

Single-turn Jailbreak Attack

AdvBench

64ASR (PAIR)

2

AdvBench Malicious-Educator

50Attack Success Rate (ASR)

2

AdvBench RPO defense (full)

92ASR

2

AdvBench PAT defense (full)

80ASR

2

Priming Attack Robustness

AdvBench First-Step GCG (test)

4ASR (GPT-4o)

2

Priming Attack Robustness

AdvBench DiJA (test)

18ASR (GPT-4o)

2

Jailbreak Attack

AdvBench Llama to gpt-3.5-turbo (transfer)

87ASR (Refusal Matching)

2

Rule-based detection performance

AdvBench (held-out)

15Union Match Rate

1

Malicious Prompt Detection

AdvBench (subset)

30Fires Rate

1

Out-of-distribution (OOD) Harmful Content Detection

AdvBench

99.2AUROC (vs Alpaca)

1

Jailbreak Prompt Classification

AdvBench 520 prompts

93Accuracy

1

Language Modeling

AdvBench

52.23PPL

1

Jailbreak Attack

AdvBench

37.6ASR@1

1

Jailbreak Attack

AdvBench

13.27Success Rate @1

1

Page 9 of 9

Popular tasks

Jailbreak Attack Jailbreaking Jailbreak Jailbreak Defense Safety Evaluation

Follow for updates

Join SOTA2 Contact