Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

HarmBench dataset and benchmarks · SOTA2 Research

Research Datasets

HarmBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Jailbreak Attack

HarmBench

100Attack Success Rate (ASR)

624

Jailbreak Attack

HarmBench (test)

100ASRHB

276

HarmBench

96.3ASR

244

Safety Evaluation

HarmBench

0ASR

153

Safety Evaluation

Harmbench

0.06Harmbench Score

127

HarmBench

84Attack Success Rate (ASR)

110

Response Harmfulness Detection

HarmBench

98.94F1 Score

100

Jailbreak Defense

HarmBench

0PAIR ASR

91

Safety Alignment

HarmBench

0ASR

88

Unsafe Robustness

HarmBench

1Unsafe Rate

72

Jailbreak Robustness

HarmBench

0HarmBench ASR

72

Multimodal Jailbreak Attack

HarmBench

0ASR

62

Safety Alignment Breaking Prevention

HarmBench

0Harmful Score (%)

60

Jailbreak Attack Success Rate

HarmBench

97Attack Success Rate (Generated)

55

HARMBENCH 159 standard behaviors (test)

0ASR

55

Harmful Prompt Refusal

HarmBench

0ASR

52

HarmBench

1.01Toxicity Score

50

HarmBench Standard Behaviours (200 examples)

0ASR

48

Jailbreak Attack

HarmBench-191 (dev)

97.4Attack Success Rate (ASR)

42

Single-turn Jailbreak Attack

HarmBench single-turn

91ASR

41

Refusal Ablation and Jailbreak Attack Success

HARMBENCH

96.27Attack Success Rate (ASR)

40

Controllability

HarmBench

87.5HarmBench Score

40

Safety Evaluation

Harmbench

3.5ASR

39

Safety Evaluation

HarmBench

93.25PAIR

39

Malicious Prompt Refusal

HarmBench

96Refusal Rate

38

Page 1 of 8

PreviousNext

Popular tasks

Jailbreak Attack Jailbreaking Safety Evaluation Red Teaming Harmful Refusal

Follow for updates

Join SOTA2 Contact