Retrieval Question Answering on SQuAD
82.1MRRADE-SPL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ADE-SPLLoss=Standard2023.06 | 82.1 | 74.5 | |
| ADE-SPLLoss=PAIR2023.06 | 82 | 74.4 | |
| SDELoss=SamToNe2023.06 | 82 | 74.6 | |
| SDELoss=Standard2023.06 | 81.9 | 74.1 | |
| ADE-SPLLoss=SamToNe2023.06 | 81.7 | 73.8 | |
| SDELoss=PAIR2023.06 | 81.7 | 74.13 | |
| SPARTATraining Setup=Trained on SQuAD + NQ2020.09 | 79 | — | |
| SPARTATraining Setup=Trained on SQuAD2020.09 | 78.5 | — | |
| ADELoss=Standard2023.06 | 74 | 64.3 | |
| ADELoss=SamToNe2023.06 | 73 | 63.6 | |
| PolyEncTraining Setup=Trained on SQuAD2020.09 | 64.6 | — | |
| PolyEncTraining Setup=Trained on SQuAD + NQ2020.09 | 63.9 | — | |
| USE-QATraining Setup=Unsupervised or pretrained2020.09 | 62.5 | — | |
| BM25Training Setup=Unsupervised or pretrained2020.09 | 58 | — |