ResearchBenchmarksMachine Translation on WMT He-En 23Follow36.3BLEUTop-k32.6633.60534.5535.495Feb 27, 2024Evaluation ResultsMethodMethodLinksBLEUChrFTop-k#Experts=128, Size=512#Experts=128, Size=5122024.0236.360.9XMOE#Experts=64, Size=1024#Experts=64, Size=10242024.0236.160.5Top-k#Experts=64, Size=1024#Experts=64, Size=10242024.0235.960.9XMOE#Experts=128, Size=512#Experts=128, Size=5122024.0235.560.1Switch#Experts=32, Size=2048#Experts=32, Size=20482024.0234.959.7Dense#Experts=1, Size=2048#Experts=1, Size=20482024.0232.858