ResearchBenchmarksMachine Translation on WMT Ru-En 23Follow28.5BLEUXMOE25.17226.03626.927.764Feb 27, 2024Evaluation ResultsMethodMethodLinksBLEUChrFXMOE#Experts=128, Size=512#Experts=128, Size=5122024.0228.553.9XMOE#Experts=64, Size=1024#Experts=64, Size=10242024.0228.454Top-k#Experts=128, Size=512#Experts=128, Size=5122024.0227.853.5Top-k#Experts=64, Size=1024#Experts=64, Size=10242024.0227.453.5Switch#Experts=32, Size=2048#Experts=32, Size=20482024.0226.752Dense#Experts=1, Size=2048#Experts=1, Size=20482024.0225.350.9