List your company
ResearchFormerly WizWand

Natural Language Understanding on GLUE (Alast/AAUC Metrics)

40.33Alast ScoreFedMosaic
23.024427.517232.0136.5028May 20, 2025
Updated 7mo ago

Evaluation results

MethodLinks
FedMosaicTraining Setting=6 rounds, 100 local steps2025.0540.3331.2
FedMosaicTraining Setting=20 rounds, 50 local steps2025.0537.1431.12
SFTTraining Setting=20 rounds, 50 local steps2025.0526.9425.26
FedITTraining Setting=20 rounds, 50 local steps2025.0526.9224.4
FedSIMTraining Setting=20 rounds, 50 local steps2025.0526.3923.9
SFTTraining Setting=6 rounds, 100 local steps2025.0526.1924.49
TAKFLTraining Setting=20 rounds, 50 local steps2025.0526.0223.66
FedITTraining Setting=6 rounds, 100 local steps2025.0525.9823.93
FedDPATraining Setting=6 rounds, 100 local steps2025.0525.7823.84
FedDPATraining Setting=20 rounds, 50 local steps2025.0525.7724.19
FedMKTTraining Setting=6 rounds, 100 local steps2025.0525.4123.63
TAKFLTraining Setting=6 rounds, 100 local steps2025.0525.3723.6
DITTOTraining Setting=20 rounds, 50 local steps2025.0525.3624.01
FedSIMTraining Setting=6 rounds, 100 local steps2025.0525.3324.24
PerADATraining Setting=20 rounds, 50 local steps2025.0525.3324.11
FedMKTTraining Setting=20 rounds, 50 local steps2025.0524.8223.27
PerADATraining Setting=6 rounds, 100 local steps2025.0524.6924.31
DITTOTraining Setting=6 rounds, 100 local steps2025.0524.6824.29
FedDATTraining Setting=6 rounds, 100 local steps2025.0524.2924.41
FedDATTraining Setting=20 rounds, 50 local steps2025.0523.6923.39