List your company
ResearchFormerly WizWand

Logical Reasoning on ReClor 1.0 (test-H)

72.9AccuracyMERIT
-2.65616.959536.57556.1905May 2, 2022Jun 9, 2022Jul 18, 2022Aug 25, 2022Oct 3, 2022Nov 10, 2022Dec 19, 2022
Updated 8mo ago

Evaluation results

MethodLinks
MERITBase Architecture=DeBERTa-v2-xxlarge2022.1272.9
APOLLOBase Architecture=DeBERTa-v2-xxlarge2022.1269.6
DeBERTa-v2-xxlargeBase Architecture=DeBERTa-v2-xxlarge2022.1268.4
APOLLOBase Architecture=DeBERTa-v32022.1265.7
DeBERTa-v3Base Architecture=DeBERTa-v32022.1264
Human Performance2022.050.672
LogiformerBackbone=RoBERTa-Large2022.050.5125
FocalReasonerBackbone=RoBERTa-Large2022.050.4464
DAGNBackbone=RoBERTa-Large2022.050.4446
XLNet-LargeBackbone=XLNet-Large2022.050.405
RoBERTa-LargeBackbone=RoBERTa-Large2022.050.4
BERT-LargeBackbone=BERT-Large2022.050.323
Random2022.050.25