Machine Translation on Google Production En→Fr (test)
2.69PerplexityMoE with 2048 Experts
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MoE with 2048 Expertsops/timestep=85M, Total #Parameters=8.7B, Training Time=1 day/64 k40s2017.01 | 2.69 | 36.57 | |
| GNMTops/timestep=214M, Total #Parameters=278M, Training Time=6 days/96 k80s2017.01 | 2.87 | 35.56 |