Language Modeling on LAMBADA (Acc, PPL, BPB)
44.36LAMBADA AccuracyInterdomain Attention
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Interdomain AttentionZero-shot=true, Model Size=1.3B, Evaluation Harness=lm-evaluation-harness2026.05 | 44.36 | 14.76 | 0.9937 | |
| SoftmaxZero-shot=true, Model Size=1.3B, Evaluation Harness=lm-evaluation-harness2026.05 | 39.43 | 21.03 | 1.1244 | |
| S4D-onlyZero-shot=true, Model Size=1.3B, Evaluation Harness=lm-evaluation-harness2026.05 | 25.64 | 41.02 | 1.3712 |