Open Table-and-Text Question Answering on OTT-QA 1.0 (test)
43EMOracle Table + Link (w/o Retrieval) + HYBRIDER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Oracle Table + Link (w/o Retrieval) + HYBRIDERRetriever Setting=Best, Ablation=Oracle Table + Link2020.10 | 43 | 49.8 | |
| Oracle Link + Fusion-Retrieval + Cross-Block ReaderRetriever Setting=Best, Ablation=Oracle Link2020.10 | 35 | 39.5 | |
| Fusion-Retrieval + Cross-Block ReaderRetriever Setting=Best2020.10 | 27.2 | 31.5 | |
| Iterative-Retrieval + Cross-Block ReaderRetriever Setting=Best2020.10 | 16.9 | 20.9 | |
| Fusion-Retrieval + Single-Block ReaderRetriever Setting=Best2020.10 | 13.4 | 16.9 | |
| HYBRIDER (best Top-K)Retriever Setting=Best2020.10 | 9.7 | 12.8 | |
| Iterative-Retrieval + Single-Block ReaderRetriever Setting=Best2020.10 | 9.6 | 13.1 | |
| Text-only Retrieval + Cross-Block ReaderRetriever Setting=Best, Ablation=Text-only2020.10 | 8.8 | 12.1 | |
| HYBRIDER (Top-1)Retriever Setting=Best2020.10 | 8.4 | 10.6 | |
| Table-only Retrieval + Cross-Block ReaderRetriever Setting=Best, Ablation=Table-only2020.10 | 4.4 | 7 |