Logical Reasoning on ReClor Easy (test)
86.4AccuracyFOCAL REASONER
Evaluation results
| Method | Links | |
|---|---|---|
| FOCAL REASONERBackbone=DeBERTa, Data Augmentation=false2021.05 | 86.4 | |
| MERITBackbone=DeBERTa2021.05 | 86.2 | |
| HGNBackbone=DeBERTa2021.05 | 84.5 | |
| DeBERTaBackbone=DeBERTa2021.05 | 83.4 | |
| LReasonerBackbone=DeBERTa2021.05 | 83.4 | |
| LReasonerData Augmentation=true2022.03 | 81.4 | |
| LReasonerBackbone=RoBERTa, Data Augmentation=true2021.05 | 81.4 | |
| AdaLoGN2022.03 | 79.32 | |
| LReasonerData Augmentation=false2022.03 | 78.6 | |
| LReasonerBackbone=RoBERTa, Data Augmentation=false2021.05 | 78.6 | |
| MERITBackbone=RoBERTa, Data Augmentation=true2021.05 | 78.1 | |
| HGNBackbone=RoBERTa2021.05 | 77.7 | |
| FOCAL REASONERBackbone=RoBERTa, Data Augmentation=false2021.05 | 77.1 | |
| Focal Reasoner2022.03 | 77.05 | |
| DAGNbackbone=RoBERTa-Large2021.03 | 76.14 | |
| DAGNBackbone=RoBERTa, Data Augmentation=false2021.05 | 76.1 | |
| DAGN (Aug)backbone=RoBERTa-Large, graph feature augmentation=true2021.03 | 75.91 | |
| DAGN2022.03 | 75.91 | |
| DAGNBackbone=RoBERTa, Data Augmentation=true2021.05 | 75.9 | |
| XLNet-Large2021.03 | 75.7 | |
| XLNet_LARGE2022.03 | 75.7 | |
| RoBERTa-Large2021.03 | 75.5 | |
| RoBERTa_LARGE2022.03 | 75.5 | |
| RoBERTaBackbone=RoBERTa2021.05 | 75.5 | |
| BERT-Large2021.03 | 72 | |
| BERT_LARGE2022.03 | 72 | |
| Human2022.03 | 57.1 | |
| Human Performance2021.05 | 53.1 |