OpenBookQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
OpenBookQA
94.4Accuracy
465
OpenBookQA
96.07Accuracy
319
OpenBookQA
84.4Accuracy
157
OpenBookQA (OBQA) (test)
92.4OBQA Accuracy
130
OpenBookQA
95.2Accuracy
119
OpenBookQA
91.2Accuracy
108
OpenBookQA
55.6Normalized Accuracy
102
OpenBookQA
88.4Accuracy
92
OpenBookQA
94.6Accuracy
89
OpenBookQA (test)
91Accuracy
61
OpenBookQA
93.6Accuracy
42
OpenBookQA 1.0 (test)
35Accuracy
33
OpenBookQA
40.6Accuracy
31
OpenBookQA
44.4Accuracy
30
OpenBookQA 2018
43Acc_norm
26
OpenbookQA
44Accuracy
26
OpenBookQA published (test)
92.6Accuracy
25
OpenBook-QA
91.6Accuracy
24
OpenbookQA
87.6Accuracy
23
OpenbookQA (OQA) (val)
36.6Accuracy
22
OpenBookQA (dev)
90Accuracy
22
OpenBookQA
81.8Accuracy
21
OpenBookQA
0.27Normalized Generalization Error Approximation
20
OpenBookQA
1.51Generalization Error (G(W))
20
OpenBookQA
92.14Composite Score
20