Table-based Fact Verification on TabFact small 1.0 (test)
93AccuracyPASTA w/ DATER
Evaluation results
| Method | Links | |
|---|---|---|
| PASTA w/ DATERLearning Paradigm=Fine-tuning based2023.01 | 93 | |
| PASTA w/ DATERLearning Paradigm=Fine-tuning based2023.01 | 93 | |
| Human2023.01 | 92.1 | |
| Human2023.01 | 92.1 | |
| PASTALearning Paradigm=Fine-tuning based2023.01 | 90.8 | |
| PASTALearning Paradigm=Fine-tuning based2023.01 | 90.8 | |
| SaMoELearning Paradigm=Fine-tuning based2023.01 | 86.7 | |
| SaMoELearning Paradigm=Fine-tuning based2023.01 | 86.7 | |
| TAPEXLearning Paradigm=Fine-tuning based2023.01 | 85.9 | |
| TAPEXLearning Paradigm=Fine-tuning based2023.01 | 85.9 | |
| Codex w/ DATERLearning Paradigm=LLM based2023.01 | 85.6 | |
| Codex w/ DATERLearning Paradigm=LLM based2023.01 | 85.6 | |
| BinderLearning Paradigm=LLM based2023.01 | 85.1 | |
| BinderLearning Paradigm=LLM based2023.01 | 85.1 | |
| TaPasLearning Paradigm=Fine-tuning based2023.01 | 83.9 | |
| TaPasLearning Paradigm=Fine-tuning based2023.01 | 83.9 | |
| SATLearning Paradigm=Fine-tuning based2023.01 | 75.5 | |
| SATLearning Paradigm=Fine-tuning based2023.01 | 75.5 | |
| LogicFactCheckerLearning Paradigm=Fine-tuning based2023.01 | 74.3 | |
| LogicFactCheckerLearning Paradigm=Fine-tuning based2023.01 | 74.3 | |
| CodexLearning Paradigm=LLM based2023.01 | 72.6 | |
| CodexLearning Paradigm=LLM based2023.01 | 72.6 | |
| Table-BERTLearning Paradigm=Fine-tuning based2023.01 | 68.1 | |
| Table-BERTLearning Paradigm=Fine-tuning based2023.01 | 68.1 | |
| Human PerformanceType=Manual Evaluation2019.09 | 0.921 | |
| LPA-Ranking w/ Discriminator (Caption)Discriminator usage=Ranking discriminator2019.09 | 0.689 |