Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

AdvBench dataset and benchmarks – Page 2 · SOTA2 Research

Research Datasets

AdvBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Jailbreak Attack

AdvBench

100ASR

42

Safety Evaluation

AdvBench Safety Evaluation

1.35ASR (S1)

42

Jailbreak Attack

AdvBench

0ASR

42

Jailbreak Attack

AdvBench gray-box setting

100ASR

42

Jailbreak Defense

AdvBench PAD

12.12ASR

40

Jailbreak Attack

AdvBench-50 + Malicious Instruct

100ASR

40

AdvBench Sub

4.73BERT Score

40

Transferable Adversarial Attack

AdvBench LLM Classifier (test)

9,260TASR@1

39

Jailbreak Attack

AdvBench GPT-3.5-turbo 1.0 (test)

97.12Attack Success Rate

38

Jailbreak Attack

AdvBench

93.48Avg.Q

36

Jailbreak Defense

AdvBench PAIR attack

98DSR

35

AdvBench (test)

99.04Average ASR

33

Jailbreaking MLLMs

AdvBench

100WASR

32

Jailbreak Attack

AdvBench 50 harmful behaviors

100GPT-3.5 Turbo Jailbreak Rate

32

Safety evaluation

AdvBench 50 examples

100Safe Response Rate

32

Visual Jailbreaking Attack

AdvBench

43.84ASR

32

Safety Alignment

AdvBench

-0.38Reward

32

Adversarial Attack Success

AdvBench (sample of 500)

16.5ASR

30

Safety Evaluation

AdvBench

100Overall Safety Score

30

Jailbreak Attack

AdvBench AdvSub

100QSR

30

Harmfulness Evaluation

AdvBench

1.04Harmfulness Score

28

AdvBench (test)

99ASR (GPT-4o)

27

Adversarial Attack

AdvBench Original (test)

0CHR

27

Adversarial Attack

AdvBench Hijacked (test)

0CHR

27

Jailbreaking Attack

AdvBench

97.7ASR

27

Page 2 of 9

Popular tasks

Jailbreak Attack Jailbreaking Jailbreak Jailbreak Defense Safety Evaluation

Follow for updates

Join SOTA2 Contact