XSTest
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
XSTest en
0.8Over-Refusal Rate
9
XSTEST-RESP (full)
98.1RR (F1)
9
XSTest
89.74Det@1
8
XSTest AR
88F1 Score
8
XSTest EN
95F1 Score
8
XSTEST
2.05HS Rate
8
XSTEST
61HPR
8
XSTest
92Compliance (Safe)
7
XSTest (test)
94.7F1 Score
7
XSTest Refusal OOD (test)
100MC Recall
7
XsTest
92.38Precision
7
XSTest
0Refusal Rate
7
XSTest
94.9F1 Score
7
XSTest (test)
87.8Precision
7
XSTest Safe
51.6Refusal Rate
6
XSTest
96.43XS Test Score
6
XSTest
89Score
6
XsTest Safe (test)
3.5Over-Refusal Rate
5
XSTest
94.1F1 Score
5
XSTest (held-out)
99.6AUROC
5
XSTest
9.89Safety Score
5
XSTest Average
88.5Safe Rate
4
XSTest Unsafe
90Safe Rate
4
xstest
94.39Macro Accuracy
4
XSTest
97.6Non-Overrefusal Rate
4