Table Question Answering on ROBUT-SQA Table Header Perturbations
68.6Pre-perturbation AccuracyTAPEX
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TAPEXPerturbation Type=Synonym Replacement2023.06 | 68.6 | 62 | 6.6 | 86.5 | |
| TAPEXPerturbation Type=Abbreviation Replacement2023.06 | 68.5 | 59.7 | 8.8 | 83.8 | |
| TAPASPerturbation Type=Synonym Replacement2023.06 | 64.4 | 57.7 | 6.7 | 85.7 | |
| TAPASPerturbation Type=Abbreviation Replacement2023.06 | 62.9 | 50 | 12.9 | 76.9 | |
| GPT-3few-shot=true, Perturbation Type=Abbreviation Replacement2023.06 | 51 | 47.3 | 3.7 | 90.6 | |
| GPT-3few-shot=true, Perturbation Type=Synonym Replacement2023.06 | 50.7 | 47.2 | 3.5 | 91.3 |