Word Sense Disambiguation on WIC SuperGLUE (test)
65.82AccuracyFedAvg
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FedAvgModel=OPT-1.3B2024.05 | 65.82 | — | |
| FedAvgModel=OPT-125M2024.05 | 60.83 | — | |
| DeComFLModel=OPT-1.3B, P=102024.05 | 56.14 | — | |
| FedZOModel=OPT-1.3B, P=102024.05 | 56.08 | — | |
| MeZOModel=OPT-1.3B, Setting=single agent2024.05 | 55.95 | — | |
| DeComFLModel=OPT-125M, P=102024.05 | 53.38 | — | |
| FedZOModel=OPT-125M, P=102024.05 | 53.37 | — | |
| MeZOModel=OPT-125M, Setting=single agent2024.05 | 53.25 | — |