List your company
ResearchFormerly WizWand

Text Classification on 20 Newsgroups Dir(0.01) (test)

0.6441AccuracyFL (w/o LoRA)
0.3324120.4133310.494250.575169Oct 30, 2024
Updated 8mo ago

Evaluation results

MethodLinks
FL (w/o LoRA)Backbone=RoBERTa-base, Communicated Parameters=186B2024.100.6441
FlexLoRABackbone=RoBERTa-base, LoRA Rank=8, Communicated Parameters=1.99B2024.100.6041
LoRA-A2Backbone=RoBERTa-base, LoRA Rank=1, Communicated Parameters=0.270B2024.100.5484
LoRA-A2Backbone=RoBERTa-base, LoRA Rank=8, Communicated Parameters=1.31B2024.100.545
LoRA-A2Backbone=RoBERTa-base, LoRA Rank=4, Communicated Parameters=0.888B2024.100.5304
LoRA-A2Backbone=RoBERTa-base, LoRA Rank=2, Communicated Parameters=0.528B2024.100.5299
FlexLoRABackbone=RoBERTa-base, LoRA Rank=4, Communicated Parameters=0.991B2024.100.505
FlexLoRABackbone=RoBERTa-base, LoRA Rank=2, Communicated Parameters=0.497B2024.100.4823
FL + LoRABackbone=RoBERTa-base, LoRA Rank=8, Communicated Parameters=1.99B2024.100.439
FL + LoRABackbone=RoBERTa-base, LoRA Rank=4, Communicated Parameters=0.991B2024.100.4312
FL + LoRABackbone=RoBERTa-base, LoRA Rank=2, Communicated Parameters=0.497B2024.100.3907
FFA-LoRABackbone=RoBERTa-base, LoRA Rank=8, Communicated Parameters=0.991B2024.100.3734
FFA-LoRABackbone=RoBERTa-base, LoRA Rank=2, Communicated Parameters=0.249B2024.100.3665
FL + LoRABackbone=RoBERTa-base, LoRA Rank=1, Communicated Parameters=0.249B2024.100.3658
FFA-LoRABackbone=RoBERTa-base, LoRA Rank=4, Communicated Parameters=0.497B2024.100.3604
FlexLoRABackbone=RoBERTa-base, LoRA Rank=1, Communicated Parameters=0.249B2024.100.3554
FFA-LoRABackbone=RoBERTa-base, LoRA Rank=1, Communicated Parameters=0.124B2024.100.3444