Linguistic Minimal Pairs on BLiMP 10% (test)
76.1BLiMP 10% AccuracyDTG
Evaluation Results
| Method | Links | |
|---|---|---|
| DTGstructural tokens added=true2026.05 | 76.1 | |
| GiLT-DPstructural tokens added=false2026.05 | 76.1 | |
| GiLT-PSDstructural tokens added=false2026.05 | 75.7 | |
| TXL-Largestructural tokens added=false, number of parameters=334M2026.05 | 75.4 | |
| PLM-Maskstructural tokens added=true2026.05 | 75.3 | |
| PLMstructural tokens added=true2026.05 | 75.1 | |
| TXL (baseline)structural tokens added=false, number of parameters=252M2026.05 | 75.1 | |
| GiLT-DMstructural tokens added=false2026.05 | 74.9 | |
| Pushdown-LMstructural tokens added=false2026.05 | 74 | |
| TGstructural tokens added=true2026.05 | 73.5 | |
| GiLT-PASstructural tokens added=false2026.05 | 73 |