Spoken Question Answering on Spoken SQuAD (B) ASR (test)
60.37EMEnsembled [(e) plus (d)]
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Ensembled [(e) plus (d)]Model Setup=Ensembled models, Composition=SpeechBERT + BERT Cascade2019.10 | 60.37 | 71.75 | |
| Ensembled [(d) plus (d)]Model Setup=Ensembled models, Composition=BERT Cascade + BERT Cascade2019.10 | 57.88 | 69.29 | |
| BERTTraining set=ASR [10], Model Setup=cascade2019.10 | 56.28 | 68.22 | |
| SpeechBERTModel Setup=End-to-end trained on Audio, Boundary Configuration=better boundaries2019.10 | 53.42 | 66.27 | |
| BERTTraining set=Text, Model Setup=trained on text2019.10 | 53.3 | 66.17 | |
| SpeechBERTModel Setup=End-to-end trained on Audio, Condition=proposed2019.10 | 51.19 | 64.08 | |
| SpeechBERTModel Setup=End-to-end trained on Audio, Pre-training=w/o MLM2019.10 | 46.02 | 59.62 | |
| Dr.QATraining set=Text, Model Setup=trained on text2019.10 | 41.16 | 54.51 | |
| BiDAFTraining set=Text, Model Setup=trained on text2019.10 | 37.02 | 50.9 |