Reading Comprehension on MultiRC Dir alpha=0.1 Standard
75.21Personalized Accuracy (Acc_p)FEDYOGI
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FEDYOGIBackbone=Llama2-7B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.05 | 75.21 | — | — | |
| SPRYBackbone=Llama2-7B, Optimization category=First-order Forward Mode AD, Dirichlet split alpha=0.12024.05 | 71.2 | -4.01 | 5.29 | |
| FWDLLM+Backbone=Llama2-7B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.05 | 65.91 | — | — | |
| BAFFLE+Backbone=Llama2-7B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.05 | 61.41 | — | — | |
| FEDAVGBackbone=Llama2-7B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.05 | 50.28 | — | — |