Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Jailbreak Detection research benchmarks – Page 4 · SOTA2 Research

Jailbreak Detection

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

embedding disruption method

87Transferred Detection Rate

2

May 12, 2026

JBShield evaluation suite Base64 attack on Llama-3-8B

100Detection Accuracy

2

May 6, 2026

JBShield evaluation suite Zulu attack on Llama-3-8B

100Accuracy

2

May 6, 2026

JBShield Puzzler attack on Llama-3-8B

100Detection Accuracy

2

May 6, 2026

JBShield evaluation suite DrAttack attack on Llama-3-8B

100Detection Accuracy

2

May 6, 2026

JBShield PAIR attack on Llama-3-8B

77Detection Accuracy

2

May 6, 2026

JBShield AutoDAN attack on Llama-3-8B

97Detection Accuracy

2

May 6, 2026

JBShield evaluation suite SAA attack on Llama-3-8B

100Detection Accuracy

2

May 6, 2026

JBShield evaluation suite IJP attack on Llama-3-8B

96Detection Accuracy

2

May 6, 2026

HILL jailbreak attacks (test)

98.03AUROC

2

Feb 26, 2026

HandCraft Prompts SIMU

1Accuracy

2

Feb 26, 2026

HandCraft Prompts TC

98Accuracy

2

Feb 26, 2026

HandCraft Prompts CR

98Accuracy

2

Feb 26, 2026

56Accuracy

2

Feb 26, 2026

38Accuracy

2

Feb 26, 2026

JB-GCG attack prompts

0.995AUROC

1

May 6, 2026

JailbreakTracer Corpus

98.88Accuracy

1

May 4, 2026

JBB-Behaviors Benign

99.96Accuracy

1

May 4, 2026

JBB-Behaviors Harmful

99.94Accuracy

1

May 4, 2026

Page 4 of 4

Popular datasets

JBShield GoalFrameBench AdvBench JailbreakBench GCG

Follow for updates

Join SOTA2 Contact