ResearchBenchmarksMachine Translation on WMT Average 23Machine Translation on WMT Average 23Follow28.7BLEUXMOE26.30826.92927.5528.171Feb 27, 2024Evaluation resultsMethodMethodLinksBLEUChrFXMOE#Experts=64, Size=1024#Experts=64, Size=10242024.0228.753.8XMOE#Experts=128, Size=512#Experts=128, Size=5122024.0228.753.7Top-k#Experts=128, Size=512#Experts=128, Size=5122024.0228.453.5Top-k#Experts=64, Size=1024#Experts=64, Size=10242024.0228.253.4Switch#Experts=32, Size=2048#Experts=32, Size=20482024.0227.652.7Dense#Experts=1, Size=2048#Experts=1, Size=20482024.0226.451.5