List your company

ResearchFormerly WizWand

WikiTQ

Benchmarks

TaskDatasetSOTA resultTrendResults

Table Question Answering

WikiTQ

91.84Accuracy

163

Table Question Answering

WikiTQ (test)

84.3Accuracy

140

Table Question Answering

WikiTQ (dev)

87.8Denotation Acc

67

Table Question Answering

WikiTQ

79.8F1 Score

50

Out-of-Distribution Agent Reasoning

WikiTQ (OOD)

74.68OOD WikiTQ Score

30

Table Question Answering

WikiTQ

77.2Accuracy

29

WikiTQ

59.7Execution Accuracy

22

Table Reasoning

WikiTQ

84.12Accuracy

18

Language-to-Code Generation

WikiTQ official (test)

74.6Execution Accuracy

12

Table Reasoning

WikiTQ

79.4Exact Match (EM)

11

Language-to-Code Generation

WikiTQ official (dev)

70.9Execution Accuracy

11

Table Question Answering

WikiTQ (challenge-set)

74.41F1 Score

10

Table Reasoning

WikiTQ (T)

65.56Accuracy

10

Table Reasoning

WikiTQ (D)

0.651Accuracy

10

Table Question Answering

WikiTQ Large (>4000 tokens)

57Accuracy

8

WikiTQ

47.6Execution Accuracy

6

Table Question Answering

WikiTQ

63.19BLEU

5