List your company
ResearchFormerly WizWand

Language Modeling on BLLIP-LG (test)

14.4PPLTXL
13.00422.42731.8541.273Feb 20, 2024Jul 4, 2024Nov 17, 2024Apr 2, 2025Aug 16, 2025Dec 30, 2025May 15, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TXLSyntactic Inductive Bias Type=Dependency-based, Model Variant=trans2024.0714.4
Pushdown-LMstructural tokens added=false2026.0514.6
TXL-Largestructural tokens added=false, number of parameters=334M2026.0514.7
TXLSyntactic Inductive Bias Type=None, Model Variant=tokens2024.0714.8
TXL (baseline)structural tokens added=false, number of parameters=252M2026.0514.8
DTGSyntactic Inductive Bias Type=Dependency-based2024.0714.9
DTGstructural tokens added=true2026.0514.9
GiLT-DMstructural tokens added=false, dependency graph type=DM2026.0514.9
GiLT-PSDstructural tokens added=false, dependency graph type=PSD2026.0514.9
DTG-swiftSyntactic Inductive Bias Type=Dependency-based2024.0715
GiLT-PASstructural tokens added=false, dependency graph type=PAS2026.0515
DTG-eagerSyntactic Inductive Bias Type=Dependency-based2024.0715.5
GiLT-DPstructural tokens added=false, dependency graph type=parse trees2026.0515.5
GPT2-token2025.0617.31
Nb-Dn-In-NmBranching strategy=Non-binary, Information flow direction=Down, Composition function type=Internal, Composition objective=Normal2025.0618.11
TGSyntactic Inductive Bias Type=Constituency-based2024.0718.4
TGstructural tokens added=true2026.0518.4
Nb-Up-In-NmBranching strategy=Non-binary, Information flow direction=Up, Composition function type=Internal, Composition objective=Normal2025.0619.36
PushdownSyntactic Inductive Bias Type=Constituency-based2024.0719.9
GPT2-tree2025.0619.97
Bi-Up-In-NmBranching strategy=Binary, Information flow direction=Up, Composition function type=Internal, Composition objective=Normal2025.0619.99
Bi-Up-Ex-NmBranching strategy=Binary, Information flow direction=Up, Composition function type=External, Composition objective=Normal2025.0620.51
Nb-Dn-Ex-NmBranching strategy=Non-binary, Information flow direction=Down, Composition function type=External, Composition objective=Normal2025.0620.88
Bi-Up-In-MBranching strategy=Binary, Information flow direction=Up, Composition function type=Internal, Composition objective=Modified2025.0621.32
Nb-Up-In-MBranching strategy=Non-binary, Information flow direction=Up, Composition function type=Internal, Composition objective=Modified2025.0622.01
Bi-Dn-In-NmBranching strategy=Binary, Information flow direction=Down, Composition function type=Internal, Composition objective=Normal2025.0622.02
Nb-Dn-In-MBranching strategy=Non-binary, Information flow direction=Down, Composition function type=Internal, Composition objective=Modified2025.0622.3
Bi-Dn-Ex-NmBranching strategy=Binary, Information flow direction=Down, Composition function type=External, Composition objective=Normal2025.0623.62
Nb-Up-Ex-NmBranching strategy=Non-binary, Information flow direction=Up, Composition function type=External, Composition objective=Normal2025.0623.85
Nb-Up-Ex-MBranching strategy=Non-binary, Information flow direction=Up, Composition function type=External, Composition objective=Modified2025.0624.07
Bi-Up-Ex-MBranching strategy=Binary, Information flow direction=Up, Composition function type=External, Composition objective=Modified2025.0624.15
Nb-Dn-Ex-MBranching strategy=Non-binary, Information flow direction=Down, Composition function type=External, Composition objective=Modified2025.0625.15
Bi-Dn-In-MBranching strategy=Binary, Information flow direction=Down, Composition function type=Internal, Composition objective=Modified2025.0626.5
Bi-Dn-Ex-MBranching strategy=Binary, Information flow direction=Down, Composition function type=External, Composition objective=Modified2025.0627.21
PLMSyntactic Inductive Bias Type=Constituency-based2024.0729.8
PLMstructural tokens added=true2026.0529.8
TG‡Tokenization Scheme=Constituency-aligned2024.0230.3
TPT [cons.]Tokenization Scheme=Constituency-aligned2024.0245.5
TPT [bin.]Tokenization Scheme=Constituency-aligned2024.0245.6
TPT [seq.]Tokenization Scheme=Dependency-aligned2024.0247.3
TPT [rand.]Tokenization Scheme=Dependency-aligned2024.0247.4
TPT [zero]Tokenization Scheme=Dependency-aligned2024.0247.5
TPT [dep.]Tokenization Scheme=Dependency-aligned2024.0247.7
PLM-mask†Tokenization Scheme=Constituency-aligned2024.0249.1
PLM-Maskstructural tokens added=true2026.0549.1
PLM+Tokenization Scheme=Constituency-aligned2024.0249.3