Logical Reasoning on ReClor EASY v1
81.4AccuracyLReasoner_RoBERTa
Evaluation results
| Method | Links | |
|---|---|---|
| LReasoner_RoBERTaBackbone=RoBERTa-large2021.05 | 81.4 | |
| LReasoner_ALBERTBackbone=ALBERT-xxlarge-v22021.05 | 81.1 | |
| ALBERTBackbone=ALBERT-xxlarge-v22021.05 | 76.6 | |
| XLNetBackbone=XLNet-large2021.05 | 75.7 | |
| RoBERTaBackbone=RoBERTa-large2021.05 | 75.5 | |
| GPTBackbone=GPT2021.05 | 73 | |
| GPT-2Backbone=GPT-22021.05 | 73 | |
| BERTBackbone=BERT-large2021.05 | 72 | |
| Human PerformanceEvaluator=Ten graduate students2021.05 | 57.1 |