ResearchBenchmarksMachine Translation on WMT Zh-En 23Machine Translation on WMT Zh-En 23Follow18.1BLEUXMOE16.64417.02217.417.778Feb 27, 2024Evaluation resultsMethodMethodLinksBLEUChrFXMOE#Experts=64, Size=1024#Experts=64, Size=10242024.0218.145.6XMOE#Experts=128, Size=512#Experts=128, Size=5122024.021845.4Top-k#Experts=128, Size=512#Experts=128, Size=5122024.0217.745.1Top-k#Experts=64, Size=1024#Experts=64, Size=10242024.0217.644.9Switch#Experts=32, Size=2048#Experts=32, Size=20482024.0217.444.8Dense#Experts=1, Size=2048#Experts=1, Size=20482024.0216.743.4