Logical Reasoning on ReClor 1.0 (test-E)
79.09AccuracyLogiformer
Evaluation results
| Method | Links | |
|---|---|---|
| LogiformerBackbone=RoBERTa-Large2022.05 | 79.09 | |
| FocalReasonerBackbone=RoBERTa-Large2022.05 | 77.05 | |
| DAGNBackbone=RoBERTa-Large2022.05 | 75.91 | |
| XLNet-LargeBackbone=XLNet-Large2022.05 | 75.7 | |
| RoBERTa-LargeBackbone=RoBERTa-Large2022.05 | 75.5 | |
| BERT-LargeBackbone=BERT-Large2022.05 | 72 | |
| Human Performance2022.05 | 57.1 | |
| Random2022.05 | 25 |