List your company

ResearchFormerly WizWand

GrailQA

Benchmarks

TaskDatasetSOTA resultTrendResults

Multi-Hop Knowledge Graph Question Answering

GrailQA

94.4Hits@1

68

Knowledge Base Question Answering

GrailQA Freebase (test)

86.9Hits@1

48

Knowledge Base Question Answering

GrailQA

89.3Hits@1

40

Knowledge Base Question Answering

GrailQA (dev)

89.5Overall F1

34

Knowledge Base Question Answering

GrailQA v1.0 (test)

77.45Overall EM

33

Hallucination Detection

GrailQA

78.82Accuracy

32

Knowledge Graph Question Answering

GrailQA (test)

91Overall Score

27

Knowledge Base Question Answering

GrailQA (test)

91.76F1

27

Knowledge Graph Question Answering

GrailQA (Overall)

86.4Hits@1

20

Knowledge Base Question Answering

GrailQA 500-sample (dev)

84.7F1 Score

18

Knowledge Graph Question Answering

GrailQA Zero-shot

89.1Hits@1

17

Knowledge Graph Question Answering

GrailQA Compositional

80Hits@1

17

Knowledge Graph Question Answering

GrailQA I.I.D.

92Hits@1

17

Knowledge Base Question Answering

GrailQA Compositional (dev)

87F1 Score

14

Knowledge Base Question Answering

GrailQA i.i.d. (dev)

93.8F1

14

Knowledge Base Question Answering

GrailQA

80.4Hits@1

11

Question Answering

GrailQA

77.03Exact Match (EM)

9

Generalization Knowledge Base Question Answering

GrailQA

89.3Hit@1

9

Knowledge Base Question Answering

GrailQA v1.0 (dev)

83.4F1

9

Knowledge Base Question Answering

GrailQAbility answerable zero-shot

78.01F1 (L)

8

Knowledge Base Question Answering

GrailQAbility answerable (IID)

89F1(L)

8

Knowledge Graph Question Answering

GrailQA IID

92.4F1 Score

6

Knowledge Base Question Answering

GrailQAbility unanswerable questions Zero-Shot (test)

88.31F1(R)

4

Knowledge Base Question Answering

GrailQAbility unanswerable questions (test IID)

97.01F1(R)

4

Knowledge Base Question Answering

GrailQA (val)

83.33Overall F1

4