List your company

ResearchFormerly WizWand

OpenBookQA

Benchmarks

TaskDatasetSOTA resultTrendResults

Question Answering

OpenBookQA

94.4Accuracy

465

Question Answering

OpenBookQA

96.07Accuracy

319

Question Answering

OpenBookQA

84.4Accuracy

157

Question Answering

OpenBookQA (OBQA) (test)

92.4OBQA Accuracy

130

Question Answering

OpenBookQA

95.2Accuracy

119

Commonsense Reasoning

OpenBookQA

91.2Accuracy

108

Question Answering

OpenBookQA

55.6Normalized Accuracy

102

OpenBookQA

88.4Accuracy

92

Science Question Answering

OpenBookQA

94.6Accuracy

89

Multiple-choice Question Answering

OpenBookQA (test)

91Accuracy

61

Question Answering

OpenBookQA

93.6Accuracy

42

Open-book Question Answering

OpenBookQA 1.0 (test)

35Accuracy

33

Question Answering

OpenBookQA

40.6Accuracy

31

Multiple Choice Question Answering

OpenBookQA

44.4Accuracy

30

Question Answering

OpenBookQA 2018

43Acc_norm

26

Zero-shot Reasoning

OpenbookQA

44Accuracy

26

Question Answering

OpenBookQA published (test)

92.6Accuracy

25

Question Answering

OpenBook-QA

91.6Accuracy

24

Question Answering

OpenbookQA

87.6Accuracy

23

Question Answering

OpenbookQA (OQA) (val)

36.6Accuracy

22

Question Answering

OpenBookQA (dev)

90Accuracy

22

OpenBookQA

81.8Accuracy

21

Question Answering

OpenBookQA

0.27Normalized Generalization Error Approximation

20

Question Answering

OpenBookQA

1.51Generalization Error (G(W))

20

Question Answering

OpenBookQA

92.14Composite Score

20