Logical Expression Evaluation on ListOps-O Length Generalization (Lengths 500-600)
99.4AccuracyEBT-GRC
Evaluation results
| Method | Links | |
|---|---|---|
| EBT-GRC2023.11 | 99.4 | |
| BT-GRC OS2023.11 | 99 | |
| RIR-EBT-GRC (-S4D)Backbone=S4D2023.11 | 98.87 | |
| CRVNN2023.11 | 98.5 | |
| RIR-EBT-GRC2023.11 | 98.25 | |
| OM2023.11 | 92.7 | |
| RIR-EBT-GRC (-Beam Align)Alignment=Beam Align2023.11 | 79.05 | |
| BBT GRC2023.11 | 40.4 | |
| RIR-GRC2023.11 | 35.55 | |
| MEGA2023.11 | 31.71 | |
| S4D2023.11 | 20.85 |