XSTest
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
XSTest
0Overrefusal Rate
102
XSTest Unsafe
0False Refusal Rate (FR)
84
XSTest Safe
4FC
78
XSTEST-RESP
95.48Response Harmfulness F1
76
XSTest
100Evaluation Score (avg@4)
70
XSTest Safe (test)
0Refusal Rate
56
XSTest
95.8F1 Score
46
XSTest Safe
1.6Over-refusal Rate
45
XSTest
97F1 Score
44
XSTest (test)
95XSTest Score
36
XSTest
0.4FRR
35
XSTest
0.984AUROC
35
XSTest (combined)
100F1 Score
34
XSTest
98.4Safety Score
32
XSTest
96Accuracy
30
XSTest Unsafe
100Refusal Rate
25
XSTest
95.2Compliance
21
XsTest Harmful
0Attack Success Rate (ASR)
20
XSTest
97.44F1 Score
20
XsTest
99Refusal Rate
20
XSTest (test)
92.91F1
20
XsTest
2Harmful Rate
16
XSTest Text Response
98.43F1 Score
16
XSTest
94.8F1 Score
16
XSTest Toxic
95Safety
15