List your company
ResearchFormerly WizWand

Question Answering on SQuAD Dir alpha=0.1 v2

19.91F1 ScoreFEDYOGI
6.40049.907713.41516.9223May 24, 2024
Updated 8mo ago

Evaluation results

MethodLinks
FEDYOGIBackbone=OPT6.7B, Optimization Approach=Backpropagation-based2024.0519.91
FEDAVGBackbone=OPT6.7B, Optimization Approach=Backpropagation-based2024.0519.06
SPRYBackbone=OPT6.7B, Optimization Approach=First-order Forward Mode AD2024.0516.75
FWDLLM+Backbone=OPT6.7B, Optimization Approach=Zero-order-based2024.0513.46
FEDMEZOBackbone=OPT6.7B, Optimization Approach=Zero-order-based2024.0513.09
FEDAVGBackbone=OPT13B, Optimization Approach=Backpropagation-based2024.0511.88
FEDYOGIBackbone=OPT13B, Optimization Approach=Backpropagation-based2024.0511.3
BAFFLE+Backbone=OPT6.7B, Optimization Approach=Zero-order-based2024.0511.09
SPRYBackbone=OPT13B, Optimization Approach=First-order Forward Mode AD2024.058.84
FEDMEZOBackbone=OPT13B, Optimization Approach=Zero-order-based2024.058.07
FWDLLM+Backbone=OPT13B, Optimization Approach=Zero-order-based2024.057.85
BAFFLE+Backbone=OPT13B, Optimization Approach=Zero-order-based2024.056.92