ResearchBenchmarksNatural Language Generation on MMLU (Subject Performance)Natural Language Generation on MMLU (Subject Performance)Follow28.1STEM ScoreSHE-LoRA21.23623.01824.826.582May 27, 2025Evaluation resultsMethodMethodLinksSTEM ScoreSS ScoreHumanities ScoreAverage ScoreSHE-LoRAsetting=heterogeneoussetting=heterogeneous2025.0528.129.226.528.2Flex-LoRAsetting=heterogeneoussetting=heterogeneous2025.0526.227.926.627.4HeterLoRAsetting=heterogeneoussetting=heterogeneous2025.0524.725.425.826FedSArank=8, setting=homoge...rank=8, setting=homogeneous2025.0521.821.419.720.1FedITrank=8, setting=homoge...rank=8, setting=homogeneous2025.0521.521.320.421.2