List your company

Natural Language Understanding on GLUE (test) (SST-2, QNLI, QQP, RTE, MNLI)

95.8SST-2 ScoreFedRot-LoRA
74.37679.93885.591.062Feb 27, 2026

Evaluation results

MethodLinks
FedRot-LoRAClients Num=10, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0295.892.186.879.886.488.18
RoLoRAClients Num=10, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0295.691.186.380.585.887.86
FedRot-LoRAClients Num=3, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0295.492.684.286.887.689.32
FedITClients Num=3, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0295.392.677.18486.687.12
RoLoRAClients Num=3, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0295.191.784.185.486.888.62
FlexLoRAClients Num=3, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0294.99183.281.384.586.98
FedITClients Num=10, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0294.991.384.962.184.983.62
FedRot-LoRAClients Num=50, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0294.79285.478.785.987.34
FFA-LoRAClients Num=10, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0294.689.484.9608482.58
FFA-LoRAClients Num=50, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0293.385.171.665.870.177.18
FedITClients Num=50, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0292.880.381.462.267.376.8
FlexLoRAClients Num=10, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0292.287.680.159.279.279.66
RoLoRAClients Num=50, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0285.189.384.773.379.882.44
FFA-LoRAClients Num=3, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0276.892.683.88386.284.48
FlexLoRAClients Num=50, Rank (r)=4, Dirichlet concentration parameter (h)=0.5, Backbone=RoBERTa-Large2026.0275.273.373.963.267.770.66