Sequential Question Answering on SQA first fold (dev)
68Accuracy (ALL)TAPAS (Counterfactual + Synthetic)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TAPAS (Counterfactual + Synthetic)Data=Counterfactual + Synthetic, Size=Large2020.10 | 68 | 45.8 | 77.7 | 68.8 | 59.6 | |
| TAPAS (Counterfactual + Synthetic)Data=Counterfactual + Synthetic, Size=Base2020.10 | 64.5 | 40.2 | 75.6 | 65.3 | 55.4 | |
| TAPAS (Synthetic)Data=Synthetic, Size=Base2020.10 | 64.1 | 41.6 | 75.3 | 64.4 | 55.8 | |
| TAPAS (Counterfactual)Data=Counterfactual, Size=Base2020.10 | 63.2 | 39.3 | 74.7 | 63.8 | 52.4 | |
| TAPAS (MASK-LM)Data=MASK-LM, Size=Base2020.10 | 60 | 35.3 | 72.4 | 59.7 | 50.5 |