Question Answering on BoolQ SuperGLUE (test)
63.83Accuracy (Test)FedAvg
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FedAvgModel=OPT-1.3B2024.05 | 63.83 | — | |
| DeComFLModel=OPT-1.3B, P=102024.05 | 62.5 | — | |
| FedAvgModel=OPT-125M2024.05 | 62.34 | — | |
| FedZOModel=OPT-1.3B, P=102024.05 | 62.14 | — | |
| MeZOModel=OPT-1.3B, Setting=single agent2024.05 | 61.98 | — | |
| DeComFLModel=OPT-125M, P=102024.05 | 61.6 | — | |
| MeZOModel=OPT-125M, Setting=single agent2024.05 | 61.46 | — | |
| FedZOModel=OPT-125M, P=102024.05 | 61.25 | — |