Machine Translation on French-English (test)
37.46BLEU ScoreMoE-Multi
Evaluation results
| Method | Links | |
|---|---|---|
| MoE-MultiParameters=8.7B, ops/timestep=102M, training time=12 days, hardware=64 k40s2017.01 | 37.46 | |
| GNMT-MonoParameters=278M/model, ops/timestep=212M, training time=various2017.01 | 36.47 | |
| GNMT-MultiParameters=278M, ops/timestep=212M, training time=21 days, hardware=96 k20s2017.01 | 34.4 |