Open-domain Question Answering on SQuAD v1.1 (dev)
38.6EMBERTserini
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BERTseriniRetrieval unit=Paragraph, k=1002019.02 | 38.6 | 46.1 | 85.8 | |
| BERTseriniRetrieval unit=Paragraph, k=292019.02 | 36.6 | 44 | 75 | |
| MINIMAL2019.02 | 34.7 | 42.5 | 64 | |
| BERTseriniRetrieval unit=Sentence, k=782019.02 | 34 | 41 | 67.5 | |
| Par. R.Answer aggregation strategy=Full Agg.2019.02 | 30.2 | — | — | |
| Dr.QAMultitask learning=true2019.02 | 29.8 | — | — | |
| Kratzwald and Feuerriegel2019.02 | 29.8 | — | — | |
| R³2019.02 | 29.1 | 37.5 | — | |
| Par. R.Answer aggregation strategy=Answer Agg.2019.02 | 28.9 | — | — | |
| Par. R.2019.02 | 28.5 | — | 83.1 | |
| Dr.QAFine-tuning=true2019.02 | 28.4 | — | — | |
| Dr.QA2019.02 | 27.1 | — | 77.8 | |
| BERTseriniRetrieval unit=Article, k=52019.02 | 19.1 | 25.9 | 63.1 |