Machine Translation on Japanese-English (test)
27.2BLEUVanilla Decoding
Evaluation results
| Method | Links | |
|---|---|---|
| Vanilla DecodingEvaluation Protocol=3-shot, Backbone=Mistral 7B, Tokens/sec=36.8, Speed Up=1.00x2024.01 | 27.2 | |
| MuMoEvaluation Protocol=3-shot, Backbone=Mistral 7B, Tokens/sec=66.3, Speed Up=1.80x2024.01 | 26.9 | |
| 1.5-entmaxactivation=1.5-entmax2019.08 | 22.13 | |
| alpha-entmaxactivation=alpha-entmax2019.08 | 21.74 | |
| softmaxactivation=softmax2019.08 | 21.57 | |
| MoE-MultiParameters=8.7B, ops/timestep=102M, training time=12 days, hardware=64 k40s2017.01 | 0.2591 | |
| GNMT-MonoParameters=278M/model, ops/timestep=212M, training time=various2017.01 | 0.2341 | |
| GNMT-MultiParameters=278M, ops/timestep=212M, training time=21 days, hardware=96 k20s2017.01 | 0.2162 |