Table-based Fact Verification on TabFact 1.0 (val)
66.1AccuracyTable-BERT
Evaluation results
| Method | Links | |
|---|---|---|
| Table-BERTLinearization scan direction=Horizontal, Sequence order=Table then Fact, Linearization strategy=Template2019.09 | 66.1 | |
| Table-BERTLinearization scan direction=Horizontal, Sequence order=Fact then Table, Linearization strategy=Template2019.09 | 66 | |
| LPA-RankingDiscriminator usage=Ranking discriminator, Aggregation=Top-1 selection2019.09 | 65.2 | |
| LPA-Ranking w/ Discriminator (Caption)Discriminator usage=Ranking discriminator, Input=Caption as sequence2019.09 | 65.1 | |
| NSM w/ LPA-guided ML + RLLearning strategy=LPA-guided ML + RL2019.09 | 63.2 | |
| LPA-Weighted-VotingDiscriminator usage=Confidence weights, Aggregation=Weighted Voting2019.09 | 62.5 | |
| LPA-VotingDiscriminator usage=None, Aggregation=Simple Voting2019.09 | 57.7 | |
| Table-BERTLinearization scan direction=Vertical, Sequence order=Fact then Table, Linearization strategy=Template2019.09 | 56.7 | |
| Table-BERTLinearization scan direction=Vertical, Sequence order=Table then Fact, Linearization strategy=Template2019.09 | 56.7 | |
| NSM w/ RL (Binary Reward)Learning strategy=Reinforcement Learning, Reward=Binary2019.09 | 54.1 | |
| BERT classifier w/o TableInput=Fact only2019.09 | 50.9 | |
| Table-BERTLinearization scan direction=Horizontal, Sequence order=Fact then Table, Linearization strategy=Concatenate2019.09 | 50.7 |