Coreference Resolution on WSC SuperGLUE (test)
65.65Accuracy (Test)FedAvg
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FedAvgModel=OPT-1.3B2024.05 | 65.65 | — | |
| DeComFLModel=OPT-1.3B, P=102024.05 | 64.16 | — | |
| FedAvgModel=OPT-125M2024.05 | 63.25 | — | |
| FedZOModel=OPT-1.3B, P=102024.05 | 61.11 | — | |
| DeComFLModel=OPT-125M, P=102024.05 | 59.59 | — | |
| FedZOModel=OPT-125M, P=102024.05 | 59.47 | — | |
| MeZOModel=OPT-1.3B, Setting=single agent2024.05 | 58.21 | — | |
| MeZOModel=OPT-125M, Setting=single agent2024.05 | 55.18 | — |