Grammaticality Judgment on BLiMP Epoch 1
81BLiMP Grammaticality Judgment (Epoch 1)NC-FFN + decay + gate
Evaluation Results
| Method | Links | |
|---|---|---|
| NC-FFN + decay + gateLayers=12L, Parameter matching=true, Seed=Single2026.06 | 81 | |
| GELU baselineLayers=12L, Parameter matching=true, Seed=Single2026.06 | 80.7 | |
| NC-FFN + decay (learned γ, λ)Layers=12L, Parameter matching=true, Seed=Single2026.06 | 80 | |
| NC-FFN + quant (no forgetting)Layers=12L, Parameter matching=true, Seed=Single2026.06 | 79.5 | |
| NC-FFN ({∩, \})Layers=12L, Parameter matching=true, Seed=Single2026.06 | 78.8 |