Natural Language Understanding on GLUE MNLI-m
87.84MNLI-m AccuracySFed-LoRA
Evaluation results
| Method | Links | |
|---|---|---|
| SFed-LoRARank=128, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 87.84 | |
| SFed-LoRARank=512, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 87.72 | |
| SFed-LoRARank=32, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 87.64 | |
| FedSA-rsLoRARank=512, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 87.27 | |
| FedSA-rsLoRARank=32, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 87.23 | |
| FedSA-rsLoRARank=128, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 87.13 | |
| SFed-LoRARank=8, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 86.51 | |
| FedSA-rsLoRARank=8, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 85.83 | |
| SFed-LoRARank=4, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 83.95 | |
| FedSA-LoRARank=128, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 82.22 | |
| FedSA-LoRARank=32, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 81.88 | |
| FedSA-LoRARank=8, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 81.31 | |
| FedSA-LoRARank=512, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 81.25 | |
| FedSA-rsLoRARank=4, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 81.24 | |
| FedSA-LoRARank=4, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 73.89 | |
| RoLoRARank=128, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 69.74 | |
| RoLoRARank=32, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 69.26 | |
| RoLoRARank=8, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 69.02 | |
| RoLoRARank=512, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 67.84 | |
| RoLoRARank=4, Backbone=RoBERTa-large, Optimizer=AdamW, Data Distribution=non-IID (α = 0.5)2026.03 | 57.72 |