Question Answering on MCScript 2.0
87.59AccuracyQA+E+C
Evaluation results
| Method | Links | |
|---|---|---|
| QA+E+Cmodel=RoBERTa-RACE, entailment=true, contradiction=true2022.09 | 87.59 | |
| QA+Emodel=RoBERTa-RACE, entailment=true2022.09 | 87.29 | |
| QA+Cmodel=RoBERTa-RACE, contradiction=true2022.09 | 87.29 | |
| QAmodel=RoBERTa-RACE2022.09 | 86.98 | |
| OLTQAFull Config=True2023.05 | 78.27 | |
| SciQ-smallvariant=small2022.09 | 66.04 | |
| SciQ-basevariant=base2022.09 | 63.71 |