Free-form Table Question Answering on FeTaQA (test)
0.3261BLEUCHAIN-OF-TABLE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CHAIN-OF-TABLEModel=PaLM 22024.01 | 0.3261 | 0.66 | 0.44 | 0.56 | |
| Codex w/ DATEREvaluation Protocol=LLM based2023.01 | 0.3092 | 0.66 | 0.45 | 0.56 | |
| T5-largeEvaluation Protocol=Fine-tuning based2023.01 | 0.3054 | 0.63 | 0.41 | 0.53 | |
| DaterModel=PaLM 22024.01 | 0.2947 | 0.63 | 0.41 | 0.53 | |
| End-to-End QAModel=PaLM 22024.01 | 0.2837 | 0.63 | 0.41 | 0.53 | |
| T5-baseEvaluation Protocol=Fine-tuning based2023.01 | 0.2814 | 0.61 | 0.39 | 0.51 | |
| CodexEvaluation Protocol=LLM based2023.01 | 0.2796 | 0.62 | 0.4 | 0.52 | |
| T5-smallEvaluation Protocol=Fine-tuning based2023.01 | 0.216 | 0.55 | 0.33 | 0.47 |