Question Answering on OTT-QA (test)
54.9EMCOS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| COSReader=Fusion-in-Encoder (FiE)2023.05 | 54.9 | 61.5 | |
| CORE2023.05 | 47.3 | 54.1 | |
| OTTer2023.05 | 37.3 | 43.1 | |
| MITQA2021.12 | 36.4 | 41.9 | |
| CARP2023.05 | 32.5 | 38.5 | |
| CARP2021.12 | 32.5 | 38.5 | |
| FR+CBR2023.05 | 27.2 | 31.5 | |
| FR+CBRretriever=Fusion Retriever (FR), reader=Cross Block Reader (CBR)2021.12 | 27.2 | 31.5 | |
| IR+CBRretriever=Iterative Retriever (IR), reader=Cross Block Reader (CBR)2021.12 | 16.9 | 20.9 | |
| FR+SBRretriever=Fusion Retriever (FR), reader=Single Block Reader (SBR)2021.12 | 13.4 | 16.2 | |
| HYBRIDER2023.05 | 9.7 | 12.8 | |
| HYBRIDERselection=best Top-K2021.12 | 9.7 | 12.8 | |
| IR+SBRretriever=Iterative Retriever (IR), reader=Single Block Reader (SBR)2021.12 | 9.6 | 13.1 | |
| HYBRIDERselection=Top-12021.12 | 8.4 | 10.6 |