Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Safety Evaluation research benchmarks – Page 13 · SOTA2 Research

Safety Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Safety Evaluation Suite WJ, FH, SR

4.6ASR (WJ)

7

Apr 23, 2026

0Refusal Rate

7

Mar 5, 2026

Causal Detoxify

95.4Task Performance

7

Feb 26, 2026

0.2ASR

7

Feb 26, 2026

Jailbroken (test)

1ASR

7

Feb 26, 2026

DeepInception (test)

78.5ASR

7

Feb 26, 2026

RedPajama Safety Evals (test)

Self-Improving Pretraining

93.4Safety Score (Avg)

7

Feb 26, 2026

MemU (with intent-legitimation suppression)

29.1ASR (Hate Speech)

7

Feb 26, 2026

Toxic Image Dataset Section 3 1.0 (test)

20.65Porn

7

Feb 26, 2026

Claude-3.7-Sonnet

95.9Safety Score

7

Feb 26, 2026

Claude-3.7-Sonnet

99.7Safety Score

7

Feb 26, 2026

Claude-3.7-Sonnet

100Safety Score

7

Feb 26, 2026

7.89Racial Bias Score

7

Feb 26, 2026

safebench-mini and harmful subset of Ch³Ef (test)

11.2SafeBench Score

7

Feb 26, 2026

Qwen2.5-14B-IT + SELF-REDTEAM

10.5ASR

6

Jul 7, 2026

Qwen2.5-14B-IT + SELF-REDTEAM

10.8ASR

6

Jul 7, 2026

Qwen2.5-3B-IT + SELF-REDTEAM

62ASR

6

Jul 7, 2026

Alpaca Mix (Unsafe)

93Refusal Rate

6

Jun 26, 2026

Alpaca Mix Safe

0Refusal Rate

6

Jun 26, 2026

WildGuard (Unsafe)

54.9Refusal Rate

6

Jun 26, 2026

WildGuard (Safe)

30.7Refusal Rate

6

Jun 26, 2026

51.6Refusal Rate

6

Jun 26, 2026

DavidAU/gemma-2-9b-it-heretic-uncensored-abliterated-Extreme

-0.153Unsafe Score

6

Jun 25, 2026

English Safety Evaluation

57.5Offensive Attack Success Rate

6

Jun 25, 2026

3.12Harm Score

6

Jun 16, 2026

Page 13 of 17

Popular datasets

XSTest HarmBench BeaverTails HEX-PHI AdvBench

Follow for updates

Join SOTA2 Contact