ResearchBenchmarksTraining Efficiency Metrics on MNLITraining Efficiency Metrics on MNLIFollow182.36Training Time (hours)FedCIO179.554198.4945217.435236.3755Nov 28, 2025Evaluation resultsMethodMethodLinksTraining Time (hours)Per-Sequence Training Cost (hours)FedCIOModel=RoBERTLARGEModel=RoBERTLARGE2025.11182.36—FedSGTModel=RoBERTLARGE, B (...Model=RoBERTLARGE, B (sequences)=102025.11241.324.13FedAvgModel=RoBERTLARGEModel=RoBERTLARGE2025.11252.51—