Syntactic Generalization on BLiMP (test)
0.773BLiMP AccuracyTXL
Evaluation results
| Method | Links | |
|---|---|---|
| TXLSyntactic Inductive Bias Type=Dependency-based, Model Variant=trans2024.07 | 0.773 | |
| DTG-swiftSyntactic Inductive Bias Type=Dependency-based2024.07 | 0.762 | |
| DTGSyntactic Inductive Bias Type=Dependency-based2024.07 | 0.761 | |
| PushdownSyntactic Inductive Bias Type=Constituency-based2024.07 | 0.756 | |
| TXLSyntactic Inductive Bias Type=None, Model Variant=tokens2024.07 | 0.753 | |
| DTG-eagerSyntactic Inductive Bias Type=Dependency-based2024.07 | 0.752 | |
| PLMSyntactic Inductive Bias Type=Constituency-based2024.07 | 0.751 | |
| TGSyntactic Inductive Bias Type=Constituency-based2024.07 | 0.735 |