Table Fact Verification on TABFACT (val)
89.2AccuracyPASTA
Evaluation results
| Method | Links | |
|---|---|---|
| PASTA2022.11 | 89.2 | |
| DeBERTaV32022.11 | 86.1 | |
| Tapex2022.11 | 84.6 | |
| SaMoE2022.11 | 84.2 | |
| TAPASModel=Large, Pre-training Objective=Counterfactual + Synthetic2020.10 | 81 | |
| Tapas2022.11 | 81 | |
| TAPASModel=Base, Pre-training Objective=Counterfactual + Synthetic2020.10 | 78.6 | |
| Schlichtkrull et al.Retrieval=Oracle2022.11 | 78.2 | |
| TAPASModel=Base, Pre-training Objective=Synthetic2020.10 | 77.6 | |
| TAPASModel=Base, Pre-training Objective=Counterfactual2020.10 | 75.5 | |
| TAPASModel=Base, Pre-training Objective=SQA2020.10 | 74.9 | |
| ProgVGAT2022.11 | 74.9 | |
| SAT2022.11 | 73.3 | |
| LOGICALFACTCHECKER (program from Seq2Action)2020.10 | 71.8 | |
| LogicFactChecker2022.11 | 71.8 | |
| LOGICALFACTCHECKER (program from LPA)2020.10 | 71.7 | |
| TAPASModel=Base, Pre-training Objective=MASK-LM2020.10 | 69.6 | |
| TABLE-BERT-Horizontal-T+F-Template2020.10 | 66.1 | |
| Table-BERT2022.11 | 66.1 | |
| LPA-Ranking w/ Discriminator (Caption)2020.10 | 65.1 | |
| BERT classifier w/o Table2020.10 | 50.9 |