Question Answering on SQuAD Dir alpha=0.1 v2 Standard
21.25F1 ScoreFEDYOGI
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FEDYOGIBackbone=OPT-6.7B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.05 | 21.25 | — | — | |
| FEDAVGBackbone=OPT-6.7B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.05 | 20.49 | — | — | |
| SPRYBackbone=OPT-6.7B, Optimization category=First-order Forward Mode AD, Dirichlet split alpha=0.12024.05 | 17.73 | -3.52 | 3.3 | |
| FWDLLM+Backbone=OPT-6.7B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.05 | 14.43 | — | — | |
| FEDMEZOBackbone=OPT-6.7B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.05 | 14.04 | — | — | |
| FEDAVGBackbone=OPT-13B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.05 | 13.06 | — | — | |
| FEDYOGIBackbone=OPT-13B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.05 | 12.49 | — | — | |
| BAFFLE+Backbone=OPT-6.7B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.05 | 12.27 | — | — | |
| SPRYBackbone=OPT-13B, Optimization category=First-order Forward Mode AD, Dirichlet split alpha=0.12024.05 | 9.88 | -3.18 | 0.78 | |
| FEDMEZOBackbone=OPT-13B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.05 | 9.1 | — | — | |
| FWDLLM+Backbone=OPT-13B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.05 | 8.96 | — | — | |
| BAFFLE+Backbone=OPT-13B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.05 | 8.17 | — | — |