List your company
ResearchFormerly WizWand

Natural Language Inference on MNLI (m/mm Accuracy)

79.15MNLI (m) AccuracyAS-LoRA
74.043675.369376.69578.0207May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
AS-LoRADP Budget (epsilon)=3, Time (s)=0.03 (1×)2026.0579.1580.03
FedSVD(1)DP Budget (epsilon)=3, Time (s)=5.44 (181×)2026.0578.4979.75
FedSVD(10)DP Budget (epsilon)=3, Time (s)=1.00 (33×)2026.0578.1679.43
FedSVD(5)DP Budget (epsilon)=3, Time (s)=1.80 (60×)2026.0577.0679.07
FedSVD(5)DP Budget (epsilon)=1, Time (s)=1.80 (60×)2026.0576.9778.16
AS-LoRADP Budget (epsilon)=1, Time (s)=0.03 (1×)2026.0576.7177.54
FedSVD(1)DP Budget (epsilon)=1, Time (s)=5.44 (181×)2026.0576.6277.79
FedSVD(10)DP Budget (epsilon)=1, Time (s)=1.00 (33×)2026.0574.2475.69