Question Answering on OTT-QA (dev)
40EMMITQA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MITQA2021.12 | 40 | 45.1 | |
| CARP2021.12 | 33.2 | 38.6 | |
| FR+CBRretriever=Fusion Retriever (FR), reader=Cross Block Reader (CBR)2021.12 | 28.1 | 32.5 | |
| IR+CBRretriever=Iterative Retriever (IR), reader=Cross Block Reader (CBR)2021.12 | 14.4 | 18.5 | |
| FR+SBRretriever=Fusion Retriever (FR), reader=Single Block Reader (SBR)2021.12 | 13.8 | 17.2 | |
| HYBRIDERselection=best Top-K2021.12 | 10.3 | 13 | |
| HYBRIDERselection=Top-12021.12 | 8.9 | 11.3 | |
| IR+SBRretriever=Iterative Retriever (IR), reader=Single Block Reader (SBR)2021.12 | 7.9 | 11.1 |