Extractive Question Answering on NewsQA MRQA
72.6F1LinkBERT
Evaluation results
| Method | Links | |
|---|---|---|
| LinkBERTModel Scale=large2022.03 | 72.6 | |
| SpanBERTNumber of training examples=Full Dataset2021.01 | 71.3 | |
| SplinterNumber of training examples=Full Dataset2021.01 | 71.3 | |
| SpanBERT (Reimpl)Number of training examples=Full Dataset2021.01 | 71.1 | |
| BERTModel Scale=large2022.03 | 70.9 | |
| RoBERTaNumber of training examples=Full Dataset2021.01 | 69.8 | |
| LinkBERTModel Scale=base2022.03 | 69.3 | |
| BERTModel Scale=base2022.03 | 65.7 | |
| SplinterNumber of training examples=10242021.01 | 57.3 | |
| SpanBERT (Reimpl)Number of training examples=10242021.01 | 52.2 | |
| SpanBERTNumber of training examples=10242021.01 | 49.3 | |
| RoBERTaNumber of training examples=10242021.01 | 47.5 | |
| SplinterNumber of training examples=1282021.01 | 43.5 | |
| LinkBERTModel Scale=tiny2022.03 | 42.8 | |
| BERTModel Scale=tiny2022.03 | 41.3 | |
| SpanBERT (Reimpl)Number of training examples=1282021.01 | 29.5 | |
| SplinterNumber of training examples=162021.01 | 20.8 | |
| SpanBERTNumber of training examples=1282021.01 | 17.4 | |
| RoBERTaNumber of training examples=1282021.01 | 16.7 | |
| SpanBERT (Reimpl)Number of training examples=162021.01 | 7.6 | |
| SpanBERTNumber of training examples=162021.01 | 6 | |
| RoBERTaNumber of training examples=162021.01 | 1.4 |