ResearchDatasetsMoE ModelFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsMoE Compression EfficiencyMoE Model 8-64 experts, d=512, d_ff=2048150Compression Ratio (64)5