Over Refusal
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Over Refusal
65.57MMLU
60
Over Refusal scenario
100ASR
42
Over-refusal (test)
0Refusal Rate
36
Over-refusal XSTest and OKTest
99.2Over-refusal Accuracy (XSTest)
12
Loading the SOTA2 catalog…