ResearchDatasetsMoE ModelMoE ModelFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsMoE Compression EfficiencyMoE Model 8-64 experts, d=512, d_ff=2048150Compression Ratio (64)5