BoolQ
Benchmarks
TaskDatasetSOTA resultTrendResults
BoolQ
91.26Accuracy
350
BoolQ
90.9Accuracy
317
BoolQ
92.4Accuracy
280
BOOLQ
94.47Accuracy
279
BoolQ
88.47Accuracy (BoolQ)
258
BoolQ
90.03Accuracy
233
BoolQ
90.7Accuracy
124
BoolQ (test)
91.752Accuracy
68
BoolQ
85.9Accuracy
57
BoolQ
88.91Accuracy
56
BoolQ
0.887MC Accuracy
50
Bool Q
87.7Accuracy
44
BoolQ (test)
99.87Accuracy
43
BoolQ
87.6Accuracy
41
BoolQ (test)
86.7Accuracy (Avg)
41
BoolQ
81.28Accuracy
39
BoolQ
85.66Accuracy (%)
37
BoolQ
0.823Zero-shot Accuracy
36
BoolQ (test)
89.45Accuracy
35
BoolQ (val)
97.7Accuracy
34
BoolQ
72Comprehensiveness
33
BoolQ 1.0 (test)
69Normalized Accuracy
33
BoolQ
85.2EM
30
BoolQ
92.3Accuracy
29
BoolQ
94.76ROC-AUC
28