Language Modeling on wiki40b Vietnamese (test)
1.057BPCWhitespaces
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| WhitespacesShortening=Dynamic2022.11 | 1.057 | 14.4 | |
| UnigramShortening=Dynamic2022.11 | 1.058 | 4 | |
| FixedShortening=Fixed, Fixed Factor=22022.11 | 1.06 | 2 | |
| GumbelShortening=Dynamic2022.11 | 1.061 | 4.3 | |
| VanillaShortening=None2022.11 | 1.065 | 1 | |
| FixedShortening=Fixed, Fixed Factor=32022.11 | 1.068 | 3 | |
| EntropyShortening=Dynamic2022.11 | 1.072 | 4.2 | |
| FixedShortening=Fixed, Fixed Factor=42022.11 | 1.087 | 4 |