Language Modeling on WikiText-103 Without Adaptive Inputs
26.44PPL (0 Context)Penumbral
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PenumbralAdaptive Inputs=false2023.06 | 26.44 | 24.31 | |
| Dot ProductAdaptive Inputs=false2023.06 | 26.62 | 24.73 | |
| UmbralAdaptive Inputs=false2023.06 | 27.82 | 26.73 |