Logical Expression Evaluation on ListOps-O Length Generalization (Lengths 900-1000)
99.5AccuracyEBT-GRC
Evaluation results
| Method | Links | |
|---|---|---|
| EBT-GRC2023.11 | 99.5 | |
| RIR-EBT-GRC (-S4D)Backbone=S4D2023.11 | 98.6 | |
| CRVNN2023.11 | 98 | |
| BT-GRC OS2023.11 | 97.2 | |
| RIR-EBT-GRC2023.11 | 97.1 | |
| OM2023.11 | 76.9 | |
| RIR-EBT-GRC (-Beam Align)Alignment=Beam Align2023.11 | 68.8 | |
| RIR-GRC2023.11 | 32.3 | |
| BBT GRC2023.11 | 31.5 | |
| MEGA2023.11 | 24.73 | |
| S4D2023.11 | 14.7 |