Question Answering on SQuAD Dir alpha=0.1 v2
19.91F1 ScoreFEDYOGI
Evaluation Results
| Method | Links | |
|---|---|---|
| FEDYOGIBackbone=OPT6.7B, Optimization Approach=Backpropagation-based2024.05 | 19.91 | |
| FEDAVGBackbone=OPT6.7B, Optimization Approach=Backpropagation-based2024.05 | 19.06 | |
| SPRYBackbone=OPT6.7B, Optimization Approach=First-order Forward Mode AD2024.05 | 16.75 | |
| FWDLLM+Backbone=OPT6.7B, Optimization Approach=Zero-order-based2024.05 | 13.46 | |
| FEDMEZOBackbone=OPT6.7B, Optimization Approach=Zero-order-based2024.05 | 13.09 | |
| FEDAVGBackbone=OPT13B, Optimization Approach=Backpropagation-based2024.05 | 11.88 | |
| FEDYOGIBackbone=OPT13B, Optimization Approach=Backpropagation-based2024.05 | 11.3 | |
| BAFFLE+Backbone=OPT6.7B, Optimization Approach=Zero-order-based2024.05 | 11.09 | |
| SPRYBackbone=OPT13B, Optimization Approach=First-order Forward Mode AD2024.05 | 8.84 | |
| FEDMEZOBackbone=OPT13B, Optimization Approach=Zero-order-based2024.05 | 8.07 | |
| FWDLLM+Backbone=OPT13B, Optimization Approach=Zero-order-based2024.05 | 7.85 | |
| BAFFLE+Backbone=OPT13B, Optimization Approach=Zero-order-based2024.05 | 6.92 |