List your company
ResearchFormerly WizWand

Logical Reasoning on ReClor (test-e)

91.8AccuracyKnowledge Model
22.32840.36458.476.436Dec 19, 2022Mar 16, 2023Jun 12, 2023Sep 8, 2023Dec 5, 2023Mar 2, 2024May 29, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Knowledge ModelBackbone=DeBERTa2023.0691.8
AMR-LEBackbone=DeBERTa2023.0687.7
IDOLBackbone=DeBERTa2023.0687.7
LReasonerBackbone=DeBERTa2023.0687.1
MERITBackbone=DeBERTa2023.0685.2
DeBERTaBackbone=DeBERTa2023.0684
LRReasonerBase model=RoBERTa-large2022.1281.4
PathReasoner2024.0580.91
MERITBase model=RoBERTa-large2022.1279.6
AdaLoGNCategory=Graph2024.0579.32
MERITCategory=Sequence, Extra data=true2024.0579.3
LogiformerCategory=Graph2024.0579.09
FOCAL REASONERBase model=RoBERTa-large2022.1277.1
FocalReasonerCategory=Graph2024.0577.05
APOLLOBase model=RoBERTa-large2022.1276.8
DAGNBase model=RoBERTa-large2022.1276.1
DAGNCategory=Graph2024.0575.91
XLNet-LargeCategory=Sequence2024.0575.7
RoBERTaBase model=RoBERTa-large2022.1275.5
ROBERTa-LargeCategory=Sequence2024.0575.5
BERT-LargeCategory=Sequence2024.0572
Human Performance2024.0557.1
Random2024.0525