Commonsense Reasoning on HellaSwag IID distribution
77.82AccuracyFedAlign-MoE
Evaluation results
| Method | Links | |
|---|---|---|
| FedAlign-MoEModel=DeepSeek-MoE-16B2026.03 | 77.82 | |
| FedMoEModel=DeepSeek-MoE-16B2026.03 | 76.11 | |
| FedAlign-MoEModel=Switch-base-162026.03 | 75.31 | |
| PFL-MoEModel=DeepSeek-MoE-16B2026.03 | 75.08 | |
| FedMoEModel=Switch-base-162026.03 | 74.46 | |
| FedProxModel=DeepSeek-MoE-16B2026.03 | 74.23 | |
| FedAvgModel=DeepSeek-MoE-16B2026.03 | 73.56 | |
| PFL-MoEModel=Switch-base-162026.03 | 73.14 | |
| FedProxModel=Switch-base-162026.03 | 72.04 | |
| FedAvgModel=Switch-base-162026.03 | 71.72 |