Natural Language Understanding on GLUE Dirichlet label skew α=0.5 (Dir(0.5))
85.71MNLI-m AccuracyGLoRA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GLoRALoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 85.71 | 85.73 | 96.33 | 87.21 | 91.82 | 89.36 | |
| FedITLoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 85.55 | 85.34 | 94.96 | 86.28 | 89.95 | 88.42 | |
| FedEx-LoRALoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 84.66 | 84.64 | 95.64 | 86.28 | 90.94 | 88.43 | |
| FedSA-LoRALoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 84.6 | 85.31 | 93.37 | 85.8 | 90.14 | 87.84 | |
| FFA-LoRALoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 82.48 | 83.12 | 95.18 | 83.42 | 89.07 | 86.65 |