List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on MCTest

100AccuracyQA+E+C
42.550457.465272.3887.2948Sep 28, 2022Nov 4, 2022Dec 12, 2022Jan 18, 2023Feb 25, 2023Apr 3, 2023May 11, 2023
Updated 8mo ago

Evaluation results

MethodLinks
QA+E+CCoverage=20%2022.09100
QA+CCoverage=50%2022.0999.76
QA+E+Cmodel=RoBERTa-RACE, entailment=true, contradiction=true2022.0991.43
QA+Emodel=RoBERTa-RACE, entailment=true2022.0991.07
QA+Cmodel=RoBERTa-RACE, contradiction=true2022.0990.83
QAmodel=RoBERTa-RACE2022.0990.48
OLTQAKnowledge Distillation=Back KD2023.0585.63
OLTQAConfiguration=Full2023.0583.75
OLTQAAblation=without Pm2023.0583.02
OLTQAKnowledge Distillation=without MKD2023.0582.19
OLTQARetriever=EPR2023.0581.98
OLTQAKnowledge Distillation=Static MKD2023.0581.87
OLTQARetriever=BM252023.0581.56
OLTQARe-ranker=excluded2023.0580.94
ProQA2023.0580
Muppet2023.0579.06
UnifiedQA2023.0577.19
Hyperformer++2023.0576.88
OLTQAAblation=without Pk2023.0576.25
SciQ-smallvariant=small2022.0959.76
EPR2023.0555
SciQ-basevariant=base2022.0944.76