Syntactic Generalization on SG suite (test)
81.2SG ScoreDTG
Evaluation Results
| Method | Links | |
|---|---|---|
| DTGstructural tokens added=true2026.05 | 81.2 | |
| GiLT-PSDstructural tokens added=false2026.05 | 79.7 | |
| TGstructural tokens added=true2026.05 | 79.6 | |
| PLMstructural tokens added=true2026.05 | 76.9 | |
| GiLT-DMstructural tokens added=false2026.05 | 76.3 | |
| GiLT-PASstructural tokens added=false2026.05 | 75.7 | |
| PLM-Maskstructural tokens added=true2026.05 | 74.7 | |
| Pushdown-LMstructural tokens added=false2026.05 | 74.6 | |
| GiLT-DPstructural tokens added=false2026.05 | 72.3 | |
| TXL (baseline)structural tokens added=false, number of parameters=252M2026.05 | 72.1 | |
| TXL-Largestructural tokens added=false, number of parameters=334M2026.05 | 71.8 |