Question Answering on BioASQ MRQA out-of-domain evaluation 2019 (test)
60.3EMRGX
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RGXSource Domain=SQuAD_wiki, Method=Extraction, Maximum Mutual Information (MMI)=true, EM selection (difficult questions)=true, Cooperative self-training (CST)=true2021.03 | 60.3 | 74.8 | |
| RGX w/o MMISource Domain=SQuAD_wiki, Method=Extraction, Maximum Mutual Information (MMI)=false, EM selection (difficult questions)=true, Cooperative self-training (CST)=true2021.03 | 59.2 | 73.6 | |
| ELECTRASource Domain=SQuAD_wiki, Method=Extraction2021.03 | 58.7 | 73.1 | |
| RGX w/o CSTSource Domain=SQuAD_wiki, Method=Extraction, Maximum Mutual Information (MMI)=true, EM selection (difficult questions)=true, Cooperative self-training (CST)=false2021.03 | 57.5 | 72.1 | |
| QAGen2SSource Domain=SQuAD_wiki, Method=Extraction2021.03 | 56.8 | 71.7 | |
| SynQASource Domain=SQuAD_wiki, Method=Extraction2021.03 | 55.1 | 68.7 | |
| T5 + RGXSource Domain=SQuAD_wiki, Method=Prompt Tuning + Seq2seq Generation2021.03 | 55.1 | 71.6 | |
| T5Source Domain=SQuAD_wiki, Method=Prompt Tuning + Seq2seq Generation2021.03 | 54.6 | 71.1 | |
| RGX w/o EMSource Domain=SQuAD_wiki, Method=Extraction, Maximum Mutual Information (MMI)=true, EM selection (difficult questions)=false, Cooperative self-training (CST)=true2021.03 | 52.1 | 64 | |
| RGXSource Domain=NaturalQuestions_wiki, Method=Extraction, Maximum Mutual Information (MMI)=true, EM selection (difficult questions)=true, Cooperative self-training (CST)=true2021.03 | 50.3 | 70.1 | |
| RGX w/o MMISource Domain=NaturalQuestions_wiki, Method=Extraction, Maximum Mutual Information (MMI)=false, EM selection (difficult questions)=true, Cooperative self-training (CST)=true2021.03 | 49.7 | 69.1 | |
| RGX w/o EMSource Domain=NaturalQuestions_wiki, Method=Extraction, Maximum Mutual Information (MMI)=true, EM selection (difficult questions)=false, Cooperative self-training (CST)=true2021.03 | 48.2 | 67.9 | |
| RGX w/o CSTSource Domain=NaturalQuestions_wiki, Method=Extraction, Maximum Mutual Information (MMI)=true, EM selection (difficult questions)=true, Cooperative self-training (CST)=false2021.03 | 45.4 | 66.4 | |
| QAGen2SSource Domain=NaturalQuestions_wiki, Method=Extraction2021.03 | 43.2 | 64.1 | |
| ELECTRASource Domain=NaturalQuestions_wiki, Method=Extraction2021.03 | 41.9 | 59 |