Natural Language Understanding on GLUE (QNLI, QQP, MNLI) (test)
87.9QNLI ScoreFedFT
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FedFTScenario=Large-scale cross-device FL, Com.=1x2022.12 | 87.9 | 88.8 | 85.6 | 87.4 | 100 | |
| FedLRScenario=Large-scale cross-device FL, Com.=↑140x2022.12 | 86 | 86.5 | 84.7 | 85.7 | 98.1 | |
| FedAPScenario=Large-scale cross-device FL, Com.=↑52x2022.12 | 85.9 | 87 | 84.9 | 85.9 | 98.3 | |
| FedPFScenario=Large-scale cross-device FL, Com.=↑12x2022.12 | 84.6 | 81.8 | 80.4 | 82.3 | 94.2 | |
| FedBFScenario=Large-scale cross-device FL, Com.=↑190x2022.12 | 80.5 | 84 | 80.7 | 81.7 | 93.5 |