Multiple Choice Question Answering on MCScript
99.82AccuracyQA+E+C
Evaluation results
| Method | Links | |
|---|---|---|
| QA+E+CCoverage=20%2022.09 | 99.82 | |
| QACoverage=20%2022.09 | 99.82 | |
| QA+CCoverage=20%2022.09 | 99.46 | |
| QACoverage=50%2022.09 | 98.78 | |
| QA+E+CCoverage=50%2022.09 | 98.57 | |
| QA+E+Cmodel=RoBERTa-RACE, entailment=true, contradiction=true2022.09 | 90.06 | |
| QA+Emodel=RoBERTa-RACE, entailment=true2022.09 | 89.92 | |
| QA+Cmodel=RoBERTa-RACE, contradiction=true2022.09 | 89.88 | |
| QAmodel=RoBERTa-RACE2022.09 | 89.7 | |
| SciQ-basevariant=base2022.09 | 61.99 | |
| SciQ-smallvariant=small2022.09 | 60.28 |