General Knowledge Evaluation on MMLU (non-IID, alpha=0.1)
39.79AccuracyFedAlign-MoE
Evaluation results
| Method | Links | |
|---|---|---|
| FedAlign-MoEModel=Switch-base-162026.03 | 39.79 | |
| FedMoEModel=Switch-base-162026.03 | 35.06 | |
| FedAlign-MoEModel=DeepSeek-MoE-16B2026.03 | 33.38 | |
| PFL-MoEModel=Switch-base-162026.03 | 33.25 | |
| FedProxModel=Switch-base-162026.03 | 31.76 | |
| FedAvgModel=Switch-base-162026.03 | 30.08 | |
| FedMoEModel=DeepSeek-MoE-16B2026.03 | 28.05 | |
| PFL-MoEModel=DeepSeek-MoE-16B2026.03 | 26.58 | |
| FedProxModel=DeepSeek-MoE-16B2026.03 | 25.89 | |
| FedAvgModel=DeepSeek-MoE-16B2026.03 | 25.43 |