Natural Language Understanding on GLUE (Self)
78.24AlastFedMosaic
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FedMosaicTraining Setting=20 rounds, 50 local steps2025.05 | 78.24 | 60.32 | |
| FedMosaicTraining Setting=6 rounds, 100 local steps2025.05 | 71.2 | 55.28 | |
| SFTTraining Setting=20 rounds, 50 local steps2025.05 | 62.88 | 51.2 | |
| FedITTraining Setting=20 rounds, 50 local steps2025.05 | 62.34 | 50.85 | |
| FedMKTTraining Setting=20 rounds, 50 local steps2025.05 | 62.21 | 50.25 | |
| FedSIMTraining Setting=20 rounds, 50 local steps2025.05 | 61.88 | 49.55 | |
| FedDPATraining Setting=20 rounds, 50 local steps2025.05 | 61.47 | 49.09 | |
| TAKFLTraining Setting=20 rounds, 50 local steps2025.05 | 61.05 | 49.89 | |
| FedDPATraining Setting=6 rounds, 100 local steps2025.05 | 61.04 | 50.19 | |
| SFTTraining Setting=6 rounds, 100 local steps2025.05 | 60.94 | 50.96 | |
| PerADATraining Setting=20 rounds, 50 local steps2025.05 | 60.8 | 49.05 | |
| FedSIMTraining Setting=6 rounds, 100 local steps2025.05 | 60.66 | 50.7 | |
| FedITTraining Setting=6 rounds, 100 local steps2025.05 | 60.53 | 50.76 | |
| TAKFLTraining Setting=6 rounds, 100 local steps2025.05 | 60.49 | 49.88 | |
| DITTOTraining Setting=20 rounds, 50 local steps2025.05 | 60.4 | 48.99 | |
| FedMKTTraining Setting=6 rounds, 100 local steps2025.05 | 60.29 | 49.14 | |
| PerADATraining Setting=6 rounds, 100 local steps2025.05 | 59.53 | 47.99 | |
| DITTOTraining Setting=6 rounds, 100 local steps2025.05 | 59.22 | 47.89 | |
| FedDATTraining Setting=20 rounds, 50 local steps2025.05 | 53.32 | 44.65 | |
| FedDATTraining Setting=6 rounds, 100 local steps2025.05 | 51.13 | 43.25 |