Natural Language Understanding on GLUE RoBERTa-Base (test)
58.21CoLA AccFedAdamW
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| FedAdamWBackbone=RoBERTa-Base, PEFT=LoRA, Communication Rounds=100, Data Partitioning=Dir-0.82025.10 | 58.21 | 66.48 | 94.03 | 87.62 | 86.76 | 90.88 | 84.55 | 81.79 | |
| SCAFFOLDBackbone=RoBERTa-Base, PEFT=LoRA, Communication Rounds=100, Data Partitioning=Dir-0.82025.10 | 57.79 | 51.62 | 93.15 | 84.25 | 86.11 | 90.32 | 83.49 | 77.82 | |
| Local AdamWBackbone=RoBERTa-Base, PEFT=LoRA, Communication Rounds=100, Data Partitioning=Dir-0.82025.10 | 56.45 | 54.15 | 93.57 | 86.93 | 86.27 | 90.73 | 84.26 | 78.91 | |
| FedCMBackbone=RoBERTa-Base, PEFT=LoRA, Communication Rounds=100, Data Partitioning=Dir-0.82025.10 | 56.29 | 64.98 | 93.25 | 83.19 | 85.56 | 88.13 | 78.9 | 78.33 | |
| FedAvgBackbone=RoBERTa-Base, PEFT=LoRA, Communication Rounds=100, Data Partitioning=Dir-0.82025.10 | 56.12 | 48.72 | 93.66 | 85.87 | 86 | 90.21 | 83.22 | 77.68 | |
| Local AdamBackbone=RoBERTa-Base, PEFT=LoRA, Communication Rounds=100, Data Partitioning=Dir-0.82025.10 | 56.08 | 62.81 | 93.8 | 85.07 | 84.55 | 88.57 | 82.62 | 79.07 | |
| FedAdamBackbone=RoBERTa-Base, PEFT=LoRA, Communication Rounds=100, Data Partitioning=Dir-0.82025.10 | 55.26 | 58.12 | 93.26 | 85.12 | 86.11 | 89.21 | 83.16 | 78.32 | |
| FedLADABackbone=RoBERTa-Base, PEFT=LoRA, Communication Rounds=100, Data Partitioning=Dir-0.82025.10 | 50 | 57.4 | 93.57 | 85.88 | 82.59 | 89.76 | 82.99 | 77.17 |