Language Modeling on wiki40b English (test)
1.077BPCWhitespaces
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| WhitespacesShortening=Dynamic2022.11 | 1.077 | 5.6 | |
| UnigramShortening=Dynamic2022.11 | 1.078 | 5 | |
| GumbelShortening=Dynamic2022.11 | 1.08 | 4.7 | |
| EntropyShortening=Dynamic2022.11 | 1.083 | 4.1 | |
| FixedShortening=Fixed, Fixed Factor=22022.11 | 1.084 | 2 | |
| VanillaShortening=None2022.11 | 1.091 | 1 | |
| FixedShortening=Fixed, Fixed Factor=32022.11 | 1.093 | 3 | |
| FixedShortening=Fixed, Fixed Factor=42022.11 | 1.102 | 4 |