QuALITY
Benchmarks
TaskDatasetSOTA resultTrendResults
QuALITY (test)
77.71Accuracy
95
QuALITY
61.78Accuracy
26
QuALITY
56.997Accuracy
19
QUALITY
83.8Exact Match
10
QuALITY Hard Subset
62.9Accuracy
6
QuALITY (test)
74.7Accuracy
6
QuaLITY
76.4P@1
6
QuALITY
73.63Accuracy
5
QuALITY multiple choice (test)
86.09Accuracy
4
QuALITY 0-shot
40.9Accuracy
4
QuALITY ZeroSCROLLS leaderboard (test)
72.8Accuracy
4
QuALITY hard
76.2Accuracy
4
QuALITY (test)
87.6Accuracy
3
QuALITY derived transfer
42.5Performance (32k Context)
2
QuALITY 0-shot
38.9Log Accuracy
2
QuALITY (dev)
37.6Exact Match
2