Chat task on Aya dataset language-skewed Non-IID
5.65Chat Score (English)FedSmoothLoRA
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| FedSmoothLoRABackbone=LLaMA-3.2-1B, Data Distribution Setting=Non-IID2026.05 | 5.65 | 4.2 | 3.35 | 4.3 | 2.75 | 3.45 | 4.5 | 4.03 | |
| FRLoRABackbone=LLaMA-3.2-1B, Data Distribution Setting=Non-IID2026.05 | 5.18 | 4.5 | 3.17 | 3.65 | 3.18 | 3.12 | 3.98 | 3.83 | |
| LoRA-FAIRBackbone=LLaMA-3.2-1B, Data Distribution Setting=Non-IID2026.05 | 4.7 | 4.13 | 3.53 | 3.6 | 2.9 | 3 | 4.18 | 3.72 | |
| FlexLoRABackbone=LLaMA-3.2-1B, Data Distribution Setting=Non-IID2026.05 | 4.62 | 4.02 | 3.23 | 3.68 | 2.8 | 2.88 | 4.07 | 3.61 | |
| FFALoRABackbone=LLaMA-3.2-1B, Data Distribution Setting=Non-IID2026.05 | 4.4 | 3.93 | 3.1 | 3.48 | 2.8 | 2.88 | 4.03 | 3.52 | |
| FedAvgM(LoRA)Backbone=LLaMA-3.2-1B, Data Distribution Setting=Non-IID2026.05 | 4.37 | 4.05 | 3.18 | 3.6 | 2.75 | 2.8 | 4.05 | 3.54 | |
| FedAvgLoRABackbone=LLaMA-3.2-1B, Data Distribution Setting=Non-IID2026.05 | 4.33 | 4.1 | 3.2 | 3.65 | 2.73 | 2.77 | 4 | 3.54 | |
| SCAFFOLD(LoRA)Backbone=LLaMA-3.2-1B, Data Distribution Setting=Non-IID2026.05 | 4.32 | 4.12 | 3.25 | 3.5 | 2.72 | 2.77 | 4.02 | 3.53 | |
| FedProx(LoRA)Backbone=LLaMA-3.2-1B, Data Distribution Setting=Non-IID2026.05 | 4.23 | 3.92 | 3.03 | 3.52 | 2.62 | 2.67 | 3.85 | 3.4 |