Commonsense Reasoning on PIQA (non-IID distribution, alpha=0.1)
74.1AccuracyFedAlign-MoE
Evaluation results
| Method | Links | |
|---|---|---|
| FedAlign-MoEModel=DeepSeek-MoE-16B2026.03 | 74.1 | |
| FedAlign-MoEModel=Switch-base-162026.03 | 73.25 | |
| FedMoEModel=DeepSeek-MoE-16B2026.03 | 72.14 | |
| PFL-MoEModel=DeepSeek-MoE-16B2026.03 | 71.36 | |
| FedMoEModel=Switch-base-162026.03 | 71.26 | |
| PFL-MoEModel=Switch-base-162026.03 | 70.08 | |
| FedProxModel=DeepSeek-MoE-16B2026.03 | 69.18 | |
| FedProxModel=Switch-base-162026.03 | 68.78 | |
| FedAvgModel=DeepSeek-MoE-16B2026.03 | 68.24 | |
| FedAvgModel=Switch-base-162026.03 | 67.92 |