Extractive Question Answering on SearchQA MRQA
83F1 ScoreSplinter
Evaluation results
| Method | Links | |
|---|---|---|
| SplinterNumber of training examples=Full Dataset2021.01 | 83 | |
| RoBERTaNumber of training examples=Full Dataset2021.01 | 81.5 | |
| SpanBERT (Reimpl)Number of training examples=Full Dataset2021.01 | 81.4 | |
| LinkBERTModel Scale=large2022.03 | 80.5 | |
| SpanBERTNumber of training examples=Full Dataset2021.01 | 80.1 | |
| BERTModel Scale=large2022.03 | 78.3 | |
| LinkBERTModel Scale=base2022.03 | 76.8 | |
| BERTModel Scale=base2022.03 | 74.2 | |
| SplinterNumber of training examples=10242021.01 | 67.3 | |
| SpanBERTNumber of training examples=10242021.01 | 60.1 | |
| SpanBERT (Reimpl)Number of training examples=10242021.01 | 58.9 | |
| LinkBERTModel Scale=tiny2022.03 | 58.6 | |
| RoBERTaNumber of training examples=10242021.01 | 54.3 | |
| BERTModel Scale=tiny2022.03 | 50.2 | |
| SplinterNumber of training examples=1282021.01 | 47.2 | |
| SpanBERTNumber of training examples=1282021.01 | 34.3 | |
| RoBERTaNumber of training examples=1282021.01 | 27.8 | |
| SplinterNumber of training examples=162021.01 | 26.3 | |
| SpanBERT (Reimpl)Number of training examples=1282021.01 | 26.3 | |
| SpanBERT (Reimpl)Number of training examples=162021.01 | 13.3 | |
| SpanBERTNumber of training examples=162021.01 | 13 | |
| RoBERTaNumber of training examples=162021.01 | 6.9 |