Logical Reasoning on LogiQA v1 (dev)
49.6AccuracyAPOLLO
Evaluation results
| Method | Links | |
|---|---|---|
| APOLLOBase Architecture=DeBERTa-v2-xxlarge2022.12 | 49.6 | |
| APOLLOBase Architecture=DeBERTa-v32022.12 | 48.4 | |
| DeBERTa-v2-xxlargeBase Architecture=DeBERTa-v2-xxlarge2022.12 | 45.9 | |
| DeBERTa-v3Base Architecture=DeBERTa-v32022.12 | 45.2 |