Language Modeling on BLLIP-LG (test)
14.4PPLTXL
Evaluation Results
| Method | Links | |
|---|---|---|
| TXLSyntactic Inductive Bias Type=Dependency-based, Model Variant=trans2024.07 | 14.4 | |
| Pushdown-LMstructural tokens added=false2026.05 | 14.6 | |
| TXL-Largestructural tokens added=false, number of parameters=334M2026.05 | 14.7 | |
| TXLSyntactic Inductive Bias Type=None, Model Variant=tokens2024.07 | 14.8 | |
| TXL (baseline)structural tokens added=false, number of parameters=252M2026.05 | 14.8 | |
| DTGSyntactic Inductive Bias Type=Dependency-based2024.07 | 14.9 | |
| DTGstructural tokens added=true2026.05 | 14.9 | |
| GiLT-DMstructural tokens added=false, dependency graph type=DM2026.05 | 14.9 | |
| GiLT-PSDstructural tokens added=false, dependency graph type=PSD2026.05 | 14.9 | |
| DTG-swiftSyntactic Inductive Bias Type=Dependency-based2024.07 | 15 | |
| GiLT-PASstructural tokens added=false, dependency graph type=PAS2026.05 | 15 | |
| DTG-eagerSyntactic Inductive Bias Type=Dependency-based2024.07 | 15.5 | |
| GiLT-DPstructural tokens added=false, dependency graph type=parse trees2026.05 | 15.5 | |
| GPT2-token2025.06 | 17.31 | |
| Nb-Dn-In-NmBranching strategy=Non-binary, Information flow direction=Down, Composition function type=Internal, Composition objective=Normal2025.06 | 18.11 | |
| TGSyntactic Inductive Bias Type=Constituency-based2024.07 | 18.4 | |
| TGstructural tokens added=true2026.05 | 18.4 | |
| Nb-Up-In-NmBranching strategy=Non-binary, Information flow direction=Up, Composition function type=Internal, Composition objective=Normal2025.06 | 19.36 | |
| PushdownSyntactic Inductive Bias Type=Constituency-based2024.07 | 19.9 | |
| GPT2-tree2025.06 | 19.97 | |
| Bi-Up-In-NmBranching strategy=Binary, Information flow direction=Up, Composition function type=Internal, Composition objective=Normal2025.06 | 19.99 | |
| Bi-Up-Ex-NmBranching strategy=Binary, Information flow direction=Up, Composition function type=External, Composition objective=Normal2025.06 | 20.51 | |
| Nb-Dn-Ex-NmBranching strategy=Non-binary, Information flow direction=Down, Composition function type=External, Composition objective=Normal2025.06 | 20.88 | |
| Bi-Up-In-MBranching strategy=Binary, Information flow direction=Up, Composition function type=Internal, Composition objective=Modified2025.06 | 21.32 | |
| Nb-Up-In-MBranching strategy=Non-binary, Information flow direction=Up, Composition function type=Internal, Composition objective=Modified2025.06 | 22.01 | |
| Bi-Dn-In-NmBranching strategy=Binary, Information flow direction=Down, Composition function type=Internal, Composition objective=Normal2025.06 | 22.02 | |
| Nb-Dn-In-MBranching strategy=Non-binary, Information flow direction=Down, Composition function type=Internal, Composition objective=Modified2025.06 | 22.3 | |
| Bi-Dn-Ex-NmBranching strategy=Binary, Information flow direction=Down, Composition function type=External, Composition objective=Normal2025.06 | 23.62 | |
| Nb-Up-Ex-NmBranching strategy=Non-binary, Information flow direction=Up, Composition function type=External, Composition objective=Normal2025.06 | 23.85 | |
| Nb-Up-Ex-MBranching strategy=Non-binary, Information flow direction=Up, Composition function type=External, Composition objective=Modified2025.06 | 24.07 | |
| Bi-Up-Ex-MBranching strategy=Binary, Information flow direction=Up, Composition function type=External, Composition objective=Modified2025.06 | 24.15 | |
| Nb-Dn-Ex-MBranching strategy=Non-binary, Information flow direction=Down, Composition function type=External, Composition objective=Modified2025.06 | 25.15 | |
| Bi-Dn-In-MBranching strategy=Binary, Information flow direction=Down, Composition function type=Internal, Composition objective=Modified2025.06 | 26.5 | |
| Bi-Dn-Ex-MBranching strategy=Binary, Information flow direction=Down, Composition function type=External, Composition objective=Modified2025.06 | 27.21 | |
| PLMSyntactic Inductive Bias Type=Constituency-based2024.07 | 29.8 | |
| PLMstructural tokens added=true2026.05 | 29.8 | |
| TG‡Tokenization Scheme=Constituency-aligned2024.02 | 30.3 | |
| TPT [cons.]Tokenization Scheme=Constituency-aligned2024.02 | 45.5 | |
| TPT [bin.]Tokenization Scheme=Constituency-aligned2024.02 | 45.6 | |
| TPT [seq.]Tokenization Scheme=Dependency-aligned2024.02 | 47.3 | |
| TPT [rand.]Tokenization Scheme=Dependency-aligned2024.02 | 47.4 | |
| TPT [zero]Tokenization Scheme=Dependency-aligned2024.02 | 47.5 | |
| TPT [dep.]Tokenization Scheme=Dependency-aligned2024.02 | 47.7 | |
| PLM-mask†Tokenization Scheme=Constituency-aligned2024.02 | 49.1 | |
| PLM-Maskstructural tokens added=true2026.05 | 49.1 | |
| PLM+Tokenization Scheme=Constituency-aligned2024.02 | 49.3 |