Extractive Question Answering on MRQA
73.6NewsQA ScoreSpanBERT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SpanBERT2019.07 | 73.6 | 83.6 | 84.8 | 83 | 82.5 | 81.5 | — | |
| Our BERT-1seqtraining_mode=single-sequence2019.07 | 71.9 | 80.4 | 84 | 80.3 | 81.8 | 79.7 | — | |
| CorefBERTModel Size=Large2020.04 | 71.5 | 73.9 | 82 | 79.1 | 79.6 | 79.6 | 91.8 | |
| Our BERTtraining_mode=bi-sequence (with NSP)2019.07 | 71 | 79 | 81.8 | 80.5 | 80.5 | 78.6 | — | |
| BERTModel Size=Large2020.04 | 69.7 | 73.1 | 81.2 | 77.7 | 79.1 | 78.6 | 91 | |
| CorefBERTModel Size=Base2020.04 | 69.5 | 70.7 | 79.6 | 76.3 | 77.7 | 77.1 | 89 | |
| Google BERTsource=Google2019.07 | 68.8 | 77.5 | 81.7 | 78.3 | 79.9 | 77.3 | — | |
| BERTModel Size=Base2020.04 | 66.9 | 68.8 | 78.5 | 74.2 | 75.6 | 75.4 | 88.4 | |
| PEMT2024.02 | 65.9 | — | 81.8 | 78.3 | 75.1 | 75.3 | — | |
| Adapter2024.02 | 65.6 | — | 81.4 | 77.6 | 74.2 | 74.7 | — | |
| FT2024.02 | 65.2 | — | 81.1 | 77.5 | 75.1 | 74.7 | — | |
| Adamix2024.02 | 65.2 | — | 80.4 | 77.5 | 73.2 | 74.1 | — | |
| LoRA2024.02 | 64.9 | — | 80.1 | 77.1 | 73.9 | 74 | — | |
| BitFit2024.02 | 64.1 | — | 77.7 | 75.5 | 70.7 | 72 | — | |
| MixDA2024.02 | 63.9 | — | 78.3 | 76.1 | 71.2 | 72.4 | — | |
| MPT2024.02 | 63.7 | — | 77.2 | 75.8 | 72 | 72.2 | — | |
| ATTEMPT2024.02 | 62.8 | — | 77.3 | 75.2 | 70.4 | 71.4 | — | |
| PT2024.02 | 61.1 | — | 75.7 | 72.9 | 67.9 | 69.4 | — | |
| SPoT2024.02 | 58.2 | — | 75.3 | 74.8 | 68.2 | 69.1 | — |