Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

AdvBench dataset and benchmarks – Page 8 · SOTA2 Research

Research Datasets

AdvBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Priming Attack Robustness

AdvBench Anchoring (test)

92ASR (GPT-4o)

5

Harmful query evaluation

AdvBench

0Harmful Rate

4

Adversarial Prompt Generation

AdvBench

1.9Time/Sample (min)

4

Jailbreak Detection

AdvBench

97.5Refusal Rate

4

Jailbreak Transfer Attack (Source: Vicuna)

AdvBench

29Llama-2 ASR

4

Jailbreak Transfer Attack (Source: Llama-2)

AdvBench

21ASR (Llama-2)

4

Jailbreak Attack

AdvBench All targets (150 goals)

98ASR

4

Jailbreak Attack

AdvBench minimax-M2.5 (50 goals)

100Attack Success Rate (ASR)

4

AdvBench Base64 prompts llama-3.1-8b

67.9Attack Success Rate (ASR)

4

AdvBench Zulu prompts llama-3.1-8b

66.8Attack Success Rate (ASR)

4

AdvBench Puzzler prompts llama-3.1-8b

100ASR

4

AdvBench DrAttack prompts llama-3.1-8b

74.1Attack Success Rate (ASR)

4

AdvBench IJP prompts llama-3.1-8b

48.9ASR

4

Jailbreak Attack

AdvBench

98StrongREJECT Score

4

Jailbreak Attack Success

AdvBench GPT-4O-MINI

55.6ASR@1

4

Jailbreak Attack Success

AdvBench GPT-3.5-TURBO

61.4ASR@1

4

Backdoor Attack

AdvBench (test)

91.3ASR

4

Backdoor Attack

AdvBench

91.8ASR

4

AdvBench-50

0Unsafe Interaction Rate

4

Adversarial Attack

AdvBench unsafe inputs

94ASR

4

SCAV-Prompt Attack Defense

AdvBench

0ASR

4

Jailbreak Attack

AdvBench

32Attack Success Rate (ASR)

3

Prompt Injection Attack Robustness

AdvBench 2023 (test)

64.9Attack Success Rate (ASP)

3

AdvBench

41PAR

3

Adversarial Safety Evaluation

AdvBench

2.69ASR (Overall)

3

Page 8 of 9

Popular tasks

Jailbreak Attack Jailbreaking Jailbreak Jailbreak Defense Safety Evaluation

Follow for updates

Join SOTA2 Contact