Question Answering on TAT-QA (EM, F1, BLEU, LJ)
74.3EMSchema-Guided
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Schema-GuidedBackbone=GPT-4.12026.06 | 74.3 | 82.6 | 68.6 | 93.2 | |
| w/o schema exten.Backbone=GPT-4.12026.06 | 72.8 | 78.6 | 67 | 91.7 | |
| w/o schema guidanceBackbone=GPT-4.12026.06 | 72.2 | 77.9 | 66.2 | 90 | |
| w/o struc. intel.Backbone=GPT-4.12026.06 | 72.2 | 76.9 | 66.7 | 90.6 | |
| Best publishedEvaluation Setting=zero-shot / no-finetuning2026.06 | 71.9 | — | — | — | |
| w/o KG ingestionBackbone=GPT-4.12026.06 | 71.7 | 77.3 | 66.8 | 91.7 | |
| single-passBackbone=GPT-4.12026.06 | 71.1 | 76.2 | 65.3 | 87.7 | |
| AtomRBackbone=GPT-4.12026.06 | 68.6 | 74.9 | 62.1 | 86.3 | |
| ProbTreeBackbone=GPT-4.12026.06 | 33.2 | 48 | 48.4 | 66.3 | |
| CoKBackbone=GPT-4.12026.06 | 26.6 | 33 | 33.9 | 45.7 | |
| RAGBackbone=GPT-4.12026.06 | 18.5 | 33.9 | 24.9 | 39 |