Natural Language Understanding on GLUE (Alast/AAUC Metrics)
40.33Alast ScoreFedMosaic
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FedMosaicTraining Setting=6 rounds, 100 local steps2025.05 | 40.33 | 31.2 | |
| FedMosaicTraining Setting=20 rounds, 50 local steps2025.05 | 37.14 | 31.12 | |
| SFTTraining Setting=20 rounds, 50 local steps2025.05 | 26.94 | 25.26 | |
| FedITTraining Setting=20 rounds, 50 local steps2025.05 | 26.92 | 24.4 | |
| FedSIMTraining Setting=20 rounds, 50 local steps2025.05 | 26.39 | 23.9 | |
| SFTTraining Setting=6 rounds, 100 local steps2025.05 | 26.19 | 24.49 | |
| TAKFLTraining Setting=20 rounds, 50 local steps2025.05 | 26.02 | 23.66 | |
| FedITTraining Setting=6 rounds, 100 local steps2025.05 | 25.98 | 23.93 | |
| FedDPATraining Setting=6 rounds, 100 local steps2025.05 | 25.78 | 23.84 | |
| FedDPATraining Setting=20 rounds, 50 local steps2025.05 | 25.77 | 24.19 | |
| FedMKTTraining Setting=6 rounds, 100 local steps2025.05 | 25.41 | 23.63 | |
| TAKFLTraining Setting=6 rounds, 100 local steps2025.05 | 25.37 | 23.6 | |
| DITTOTraining Setting=20 rounds, 50 local steps2025.05 | 25.36 | 24.01 | |
| FedSIMTraining Setting=6 rounds, 100 local steps2025.05 | 25.33 | 24.24 | |
| PerADATraining Setting=20 rounds, 50 local steps2025.05 | 25.33 | 24.11 | |
| FedMKTTraining Setting=20 rounds, 50 local steps2025.05 | 24.82 | 23.27 | |
| PerADATraining Setting=6 rounds, 100 local steps2025.05 | 24.69 | 24.31 | |
| DITTOTraining Setting=6 rounds, 100 local steps2025.05 | 24.68 | 24.29 | |
| FedDATTraining Setting=6 rounds, 100 local steps2025.05 | 24.29 | 24.41 | |
| FedDATTraining Setting=20 rounds, 50 local steps2025.05 | 23.69 | 23.39 |