Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Over-refusal research benchmarks · SOTA2 Research

Over-refusal

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

0Overrefusal Rate

102

Jun 25, 2026

Wildjailbreak (Benign)

Categorical Steering

1.43Wildjailbreak Benign Refusal Rate

49

Mar 17, 2026

Over Refusal scenario

100ASR

42

May 15, 2026

Over-refusal Evaluation Suite (XSTest, WildJailbreak, WildGuard, OKTest, OR-Bench)

3.2XSTest Refusal Rate (%)

24

Feb 26, 2026

Over-refusal XSTest and OKTest

99.2Over-refusal Accuracy (XSTest)

12

Mar 9, 2026

Popular datasets

Over Refusal XSTest Wildjailbreak Over-refusal Evaluation Suite

Follow for updates

Join SOTA2 Contact