Natural Language Understanding on GLUE (MNLI, QNLI, SST2, QQP)
88.15MNLI AccuracyFedTreeLoRA
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| FedTreeLoRARank=4, % Param=0.1107%2026.02 | 88.15 | 93.37 | 96.56 | 91.35 | 92.36 | 5.16 | |
| FedLEASERank=4, % Param=0.1521%2026.02 | 86.21 | 92.56 | 95.63 | 90.36 | 91.19 | 3.99 | |
| FedALTRank=4, % Param=0.1383%2026.02 | 84.03 | 90.77 | 96.16 | 89.27 | 90.06 | 2.86 | |
| FedDPARank=4, % Param=0.1107%2026.02 | 83.97 | 91.31 | 95.72 | 89.74 | 90.19 | 2.99 | |
| FedSARank=4, % Param=0.1107%2026.02 | 83.63 | 91.32 | 95.87 | 89.33 | 90.04 | 2.84 | |
| FedITRank=4, % Param=0.1107%2026.02 | 83.18 | 87.03 | 93.65 | 84.93 | 87.2 | — | |
| FFA-LoRARank=8, % Param=0.1107%2026.02 | 83.13 | 88.9 | 93.95 | 83.62 | 87.4 | 0.2 | |
| FFA-LoRARank=4, % Param=0.0553%2026.02 | 83.02 | 87.47 | 93.73 | 83.48 | 86.93 | 0.27 |