Table Question Answering on FeTaQA
40.5S-BLEUCABINET
Evaluation Results
| Method | Links | |
|---|---|---|
| CABINET# params=560 M2024.02 | 40.5 | |
| FlanT5-xl# params=2.9 B, Learning Paradigm=Fine-tuning text-based LLMs2024.02 | 36.2 | |
| OmniTab# params=406 M, Learning Paradigm=Fine-tuning Table-specific LLMs2024.02 | 34.9 | |
| TAPEX# params=406 M, Learning Paradigm=Fine-tuning Table-specific LLMs2024.02 | 34.7 | |
| PeaQA# params=406 M, Learning Paradigm=Fine-tuning Table-specific LLMs2024.02 | 33.5 | |
| T5-3b# params=2.9 B, Learning Paradigm=Fine-tuning text-based LLMs2024.02 | 33.4 | |
| DATER# params=175 B, Learning Paradigm=Few/zero shot Prompting of LLMs2024.02 | 30.9 | |
| T5-large# params=738 M, Learning Paradigm=Fine-tuning text-based LLMs2024.02 | 30.5 | |
| T5-base# params=222 M, Learning Paradigm=Fine-tuning text-based LLMs2024.02 | 28.1 | |
| Codex# params=175 B, Learning Paradigm=Few/zero shot Prompting of LLMs2024.02 | 27.9 | |
| Codex-COT# params=175 B, Learning Paradigm=Few/zero shot Prompting of LLMs2024.02 | 27 | |
| T5-small# params=60 M, Learning Paradigm=Fine-tuning text-based LLMs2024.02 | 21.6 |