List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on QASC

100AccuracyQA
28.34446.94765.5584.153Sep 28, 2022Nov 4, 2022Dec 12, 2022Jan 18, 2023Feb 25, 2023Apr 3, 2023May 11, 2023
Updated 8mo ago

Evaluation results

MethodLinks
QACoverage=20%2022.09100
QACoverage=50%2022.09100
QA+E+Cmodel=RoBERTa-RACE, entailment=true, contradiction=true2022.0998.6
QA+Emodel=RoBERTa-RACE, entailment=true2022.0998.49
QA+Cmodel=RoBERTa-RACE, contradiction=true2022.0998.38
QAmodel=RoBERTa-RACE2022.0998.16
SciQ-basevariant=base2022.0993.41
SciQ-smallvariant=small2022.0990.6
OLTQAKnowledge Distillation=Back KD2023.0551.08
OLTQAConfiguration=Full2023.0550.65
OLTQAKnowledge Distillation=Static MKD2023.0548.92
OLTQAKnowledge Distillation=without MKD2023.0546
OLTQARetriever=EPR2023.0543.63
OLTQAAblation=without Pm2023.0543.09
OLTQARetriever=BM252023.0542.76
OLTQARe-ranker=excluded2023.0539.52
EPR2023.0538.09
OLTQAAblation=without Pk2023.0536.83
UnifiedQA2023.0534.88
Hyperformer++2023.0533.15
Muppet2023.0532.62
ProQA2023.0531.1