Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

HarmBench dataset and benchmarks – Page 8 · SOTA2 Research

Research Datasets

HarmBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Adversarial safety

HarmBench

49.12Accuracy

2

Rule-based detection performance

HarmBench (held-out)

7Union Match

1

Out-of-distribution (OOD) Harmful Content Detection

HarmBench

0.961AUROC (vs Alpaca)

1

Refusal Evaluation

HarmBench

71Baseline Performance

1

General Safety / Red-Teaming

HarmBench

—Primary metric

0

Page 8 of 8

Popular tasks

Jailbreak Attack Jailbreaking Safety Evaluation Red Teaming Harmful Refusal

Follow for updates

Join SOTA2 Contact