HiTab
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HiTab
94.1Accuracy
129
HiTab
84.41F1 Score
50
HiTab (val)
69.83Validation Reward (mean@4)
32
HiTab
64.71Accuracy
30
HiTab (held-in)
58.2Accuracy
21
HiTab
87.24Accuracy
19
HiTab
80.17Accuracy
18
HiTab
70.1Pass@1
16
HiTab (test)
76.08Accuracy (%)
15
HiTab (test)
63Accuracy
11
HiTab T2T
16.96BLEU
11
HiTab
70.5Accuracy
10
HiTab (test)
64Exact Match
8
HiTab (test)
79.1Accuracy
6
HiTab Subset (test)
68.37EM
6
HiTab (test)
16.3BLEU
6
HiTab (test)
47Execution Accuracy
5
HiTab (dev)
48.8Execution Accuracy
5
HiTab (dev)
63.51Accuracy
4
HiTab
67.1pass@1
3
HiTab
6.19Question Answering Latency (s)
3
HiTab I (held-in)
54TEDS Score
3