List your company
ResearchFormerly WizWand

Question Answering on SQuAD Dir alpha=0.1 v2 Standard

21.25F1 ScoreFEDYOGI
7.646811.178414.7118.2416May 24, 2024
Updated 8mo ago

Evaluation results

MethodLinks
FEDYOGIBackbone=OPT-6.7B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.0521.25——
FEDAVGBackbone=OPT-6.7B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.0520.49——
SPRYBackbone=OPT-6.7B, Optimization category=First-order Forward Mode AD, Dirichlet split alpha=0.12024.0517.73-3.523.3
FWDLLM+Backbone=OPT-6.7B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.0514.43——
FEDMEZOBackbone=OPT-6.7B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.0514.04——
FEDAVGBackbone=OPT-13B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.0513.06——
FEDYOGIBackbone=OPT-13B, Optimization category=Backpropagation-based, Dirichlet split alpha=0.12024.0512.49——
BAFFLE+Backbone=OPT-6.7B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.0512.27——
SPRYBackbone=OPT-13B, Optimization category=First-order Forward Mode AD, Dirichlet split alpha=0.12024.059.88-3.180.78
FEDMEZOBackbone=OPT-13B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.059.1——
FWDLLM+Backbone=OPT-13B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.058.96——
BAFFLE+Backbone=OPT-13B, Optimization category=Zero-order-based, Dirichlet split alpha=0.12024.058.17——