Language Modeling on FLORES-200 (test)
76.9Mean PerplexityGoldfish
Evaluation Results
| Method | Links | |
|---|---|---|
| GoldfishGoldfish data size=1000MB, # Langs=732024.08 | 76.9 | |
| XGLM 4.5BGoldfish data size=1000MB, # Langs=732024.08 | 78.6 | |
| MaLA-500 10BGoldfish data size=1000MB, # Langs=732024.08 | 84.7 | |
| GoldfishGoldfish data size=100MB, # Langs=222024.08 | 102.7 | |
| BigramsGoldfish data size=1000MB, # Langs=732024.08 | 112.3 | |
| MaLA-500 10BGoldfish data size=100MB, # Langs=222024.08 | 121.7 | |
| GoldfishGoldfish data size=10MB, 5MB, # Langs=52024.08 | 130.5 | |
| BigramsGoldfish data size=100MB, # Langs=222024.08 | 132.6 | |
| MaLA-500 10BGoldfish data size=10MB, 5MB, # Langs=52024.08 | 135 | |
| XGLM 4.5BGoldfish data size=100MB, # Langs=222024.08 | 143.9 | |
| BigramsGoldfish data size=10MB, 5MB, # Langs=52024.08 | 148.3 | |
| XGLM 4.5BGoldfish data size=10MB, 5MB, # Langs=52024.08 | 183.1 |