Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Jailbreak Safety Evaluation research benchmarks · SOTA2 Research

Jailbreak Safety Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

MM-Safety Bench (test)

0.18Average ASR

56

Feb 26, 2026

2ASR

20

Jun 16, 2026

Multi-Shot Jailbreak (MSJ)

0ASR

20

Jun 16, 2026

2Attack Success Rate (J)

9

Apr 14, 2026

English dataset Multi-Image

14StrongREJECT (Perturbed)

6

Feb 26, 2026

English dataset Single-Image

10StrongREJECT (Perturbed)

6

Feb 26, 2026

English dataset Text

0.01StrongREJECT Rate

6

Feb 26, 2026

Gemini 2.5 Flash-Lite

100Cipher Success Rate

5

Apr 27, 2026

StrongREJECT (test)

100Overall Score

5

Mar 9, 2026

Popular datasets

English dataset MM-Safety Bench JailbreakBench StrongREJECT shape

Follow for updates

Join SOTA2 Contact