Table Fact Verification on TABFACT simple (test)
96.7AccuracyPASTA
Evaluation Results
| Method | Links | |
|---|---|---|
| PASTA2022.11 | 96.7 | |
| REASTAP2022.10 | 94.1 | |
| TAPEXpre-training_steps=50000, fine-tuning_steps=200002021.07 | 93.9 | |
| Tapex2022.11 | 93.9 | |
| TAPEX2022.10 | 93.7 | |
| DecompTaPas2022.10 | 93.6 | |
| SaMoE2022.11 | 93.6 | |
| TableFormer2022.10 | 93.3 | |
| DeBERTaV32022.11 | 92.8 | |
| TAPASModel=Large, Pre-training Objective=Counterfactual + Synthetic2020.10 | 92.3 | |
| Eisenschlos et al.model_category=Pre-trained Language Models2021.07 | 92.3 | |
| TaPas2022.10 | 92.3 | |
| Tapas2022.11 | 92.3 | |
| BART2021.07 | 90.7 | |
| BART2022.10 | 90.6 | |
| TAPASModel=Base, Pre-training Objective=Counterfactual + Synthetic2020.10 | 90.5 | |
| TAPASModel=Base, Pre-training Objective=Synthetic2020.10 | 89.7 | |
| Schlichtkrull et al.Retrieval=Oracle2022.11 | 88.9 | |
| Yang et al.model_category=Pre-trained Language Models2021.07 | 88.3 | |
| ProgVGAT2022.11 | 88.3 | |
| TAPASModel=Base, Pre-training Objective=Counterfactual2020.10 | 87.8 | |
| TAPASModel=Base, Pre-training Objective=SQA2020.10 | 87.2 | |
| Shi et al.model_category=Pre-trained Language Models2021.07 | 85.9 | |
| HeterTFV2022.10 | 85.9 | |
| LOGICALFACTCHECKER (program from LPA)2020.10 | 85.5 | |
| Zhang et al.model_category=Pre-trained Language Models2021.07 | 85.5 | |
| SAT2022.10 | 85.5 | |
| SAT2022.11 | 85.5 | |
| LOGICALFACTCHECKER (program from Seq2Action)2020.10 | 85.4 | |
| Zhong et al.model_category=Pre-trained Language Models2021.07 | 85.4 | |
| LFC2022.10 | 85.4 | |
| LogicFactChecker2022.11 | 85.4 | |
| TAPASModel=Base, Pre-training Objective=MASK-LM2020.10 | 82 | |
| TABLE-BERT-Horizontal-T+F-Template2020.10 | 79.1 | |
| Chen et al.model_category=Pre-trained Language Models2021.07 | 79.1 | |
| Table-BERT2022.11 | 79.1 | |
| LPA-Ranking w/ Discriminator (Caption)2020.10 | 78.7 | |
| LPA-Ranking2022.10 | 78.7 | |
| BERT classifier w/o Table2020.10 | 51 |