Commonsense Reasoning on HellaSwag non-IID distribution (alpha=0.1)
58.47AccuracyFedAlign-MoE
Evaluation results
| Method | Links | |
|---|---|---|
| FedAlign-MoEModel=Switch-base-162026.03 | 58.47 | |
| FedAlign-MoEModel=DeepSeek-MoE-16B2026.03 | 57.11 | |
| FedMoEModel=Switch-base-162026.03 | 56.42 | |
| FedMoEModel=DeepSeek-MoE-16B2026.03 | 54.8 | |
| PFL-MoEModel=Switch-base-162026.03 | 54.76 | |
| PFL-MoEModel=DeepSeek-MoE-16B2026.03 | 53.44 | |
| FedProxModel=Switch-base-162026.03 | 52.88 | |
| FedAvgModel=Switch-base-162026.03 | 52.06 | |
| FedProxModel=DeepSeek-MoE-16B2026.03 | 51.79 | |
| FedAvgModel=DeepSeek-MoE-16B2026.03 | 51.05 |