WikiTableQuestions
Benchmarks
TaskDatasetSOTA resultTrendResults
WikiTableQuestions (test)
76.6Accuracy
86
WikiTableQuestions (WikiTQ) 639 problems solvable in Excel (test)
84.19Execution Match (EM)
51
WikiTableQuestions (WTQ) (test)
81.4Accuracy
26
WikiTableQuestions (dev)
64.8Accuracy
25
WikiTableQuestions (WikiTQ)
84.47WikiTQ Accuracy
24
WikiTableQuestions OOD
83.34Accuracy
18
WikiTableQuestions (WTQ) T (original tables) (sampled subset)
73.65Accuracy
18
WIKITABLEQUESTIONS (test)
52.3Execution Accuracy (Best)
17
WIKITABLEQUESTIONS (dev)
53Execution Accuracy (Best)
16
WikiTableQuestions 17 (test)
80.8Accuracy
12
WikiTableQuestions (WTQ) complete (test)
73.6Accuracy
11
WikiTableQuestions
76.2Accuracy
5
WikiTableQuestions (WTQ) (test)
25.3Accuracy
2