Over-refusal
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
0Overrefusal Rate
102
Jun 25, 2026
1.43Wildjailbreak Benign Refusal Rate
49
Mar 17, 2026
100ASR
42
May 15, 2026
3.2XSTest Refusal Rate (%)
24
Feb 26, 2026
99.2Over-refusal Accuracy (XSTest)
12
Mar 9, 2026