Language Modeling on WikiText-103 Adaptive Inputs
20.72PPL (0 Context)Penumbral
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PenumbralAdaptive Inputs=true2023.06 | 20.72 | 19.01 | |
| Dot ProductAdaptive Inputs=true2023.06 | 20.86 | 19.22 | |
| UmbralAdaptive Inputs=true2023.06 | 21.16 | 19.59 |