Table Question Answering on ROBUT-WTQ Column Extension (test)
92Accuracy (Pre-perturbation)TAPEX
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TAPEXEvaluation Protocol=Fine-tuned2023.06 | 92 | 53.2 | 57.1 | |
| OmniTabEvaluation Protocol=Fine-tuned2023.06 | 91.2 | 53.8 | 57.6 | |
| TAPASEvaluation Protocol=Fine-tuned2023.06 | 89.8 | 51.9 | 56.4 | |
| TableFormerEvaluation Protocol=Fine-tuned2023.06 | 86 | 50.8 | 58.8 | |
| GPT-3Evaluation Protocol=Few-shot, Sample Size=2002023.06 | 80.2 | 55.5 | 56.4 | |
| OmniTabEvaluation Protocol=Fine-tuned2023.06 | 63.7 | 52.9 | 74.7 | |
| TAPEXEvaluation Protocol=Fine-tuned2023.06 | 61.2 | 47.8 | 71.4 | |
| TableFormerEvaluation Protocol=Fine-tuned2023.06 | 52.5 | 45 | 74.8 | |
| TAPASEvaluation Protocol=Fine-tuned2023.06 | 50.9 | 42.5 | 73.4 | |
| GPT-3Evaluation Protocol=Few-shot2023.06 | 47.9 | 45.2 | 81.4 |