Natural Language Understanding on GLUE Dirichlet label skew α=0.1
72.89MNLI-m AccuracyGLoRA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GLoRALoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 72.89 | 72.66 | 94.49 | 85.07 | 84.42 | 81.91 | |
| FedEx-LoRALoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 71.95 | 71.97 | 95.27 | 84.27 | 84.17 | 81.33 | |
| FedITLoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 71.74 | 71.68 | 93.69 | 83.98 | 83.91 | 81 | |
| FFA-LoRALoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 67.81 | 69.27 | 93.92 | 82.31 | 81.95 | 79.05 | |
| FedSA-LoRALoRA rank=8, Local batch size=128, Local steps=10, Communication rounds=1000, Rank homogeneity=homogeneous2026.05 | 53.76 | 53.11 | 75 | 63.18 | 52.37 | 59.48 |