Question Answering on QASPER Extractive (dev)
29.6F1DOCHOPPER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DOCHOPPERruntime=74.6/s2021.06 | 29.6 | 14 | |
| DOCHOPPERsparse_features=without2021.06 | 29.6 | 14 | |
| DOCHOPPERquery_update=without2021.06 | 28 | 12.2 | |
| DOCHOPPERattention_steps=single-hop2021.06 | 27.3 | 11.8 | |
| DOCHOPPERscope=sentence-only2021.06 | 27.2 | 11.4 | |
| LEDruntime=0.5/s2021.06 | 26.1 | — | |
| Sequential (ETC)runtime=0.6±0.1/s2021.06 | 24.6 | 11.2 | |
| Retrieval + ETCretriever=BM25, runtime=8.3/s2021.06 | 18.7 | 8.3 |