Language Modeling on wiki40b Finnish (test)
0.937BPCUnigram
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| UnigramShortening=Dynamic2022.11 | 0.937 | 2.1 | |
| GumbelShortening=Dynamic2022.11 | 0.941 | 2.6 | |
| VanillaShortening=None2022.11 | 0.945 | 1 | |
| FixedShortening=Fixed, Fixed Factor=22022.11 | 0.946 | 2 | |
| EntropyShortening=Dynamic2022.11 | 0.949 | 4.1 | |
| FixedShortening=Fixed, Fixed Factor=32022.11 | 0.951 | 3 | |
| WhitespacesShortening=Dynamic2022.11 | 0.955 | 7.9 | |
| FixedShortening=Fixed, Fixed Factor=42022.11 | 0.961 | 4 |