List your company
ResearchFormerly WizWand

Question Answering on RACE-C

93.66AccuracyQA
24.739242.632160.52578.4179Sep 28, 2022Nov 4, 2022Dec 12, 2022Jan 18, 2023Feb 25, 2023Apr 3, 2023May 11, 2023
Updated 8mo ago

Evaluation results

MethodLinks
QACoverage=20%2022.0993.66
QACoverage=50%2022.0987.36
QAmodel=RoBERTa-RACE2022.0969.8
QA+E+Cmodel=RoBERTa-RACE, entailment=true, contradiction=true2022.0969.8
QA+Cmodel=RoBERTa-RACE, contradiction=true2022.0969.8
QA+Emodel=RoBERTa-RACE, entailment=true2022.0969.66
OLTQAsetting=zero-shot2023.0556.88
OLTQAFull Config=True2023.0556.88
ProQAsetting=zero-shot2023.0554.91
ProQA2023.0554.91
OLTQA (w/o Pm)setting=zero-shot2023.0553.51
OLTQA (w/o Pk)setting=zero-shot2023.0553.23
Hyperformer++setting=zero-shot2023.0552.11
Muppetsetting=zero-shot2023.0550
UnifiedQAsetting=zero-shot2023.0549.86
UnifiedQA2023.0549.86
EPRsetting=zero-shot2023.0535.39
SciQ-smallvariant=small2022.0930.62
SciQ-basevariant=base2022.0927.39