Commonsense Reasoning on HellaSwag (Best Acc, Final Acc, Loss, Basis Overlap)
45.4Best AccuracySubspace-Reg
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Subspace-RegBackbone=RoBERTa-large, Client distribution=10-client non-IID, Number of seeds=32026.06 | 45.4 | 42.5 | 42.9 | 1.363 | 99.998 | |
| FedSVDBackbone=RoBERTa-large, Client distribution=10-client non-IID, Number of seeds=32026.06 | 33.6 | 32.1 | 33.6 | 1.3823 | 95.78 | |
| FedAvgBackbone=RoBERTa-large, Client distribution=10-client non-IID, Number of seeds=32026.06 | 33.4 | 32.2 | 33.2 | 1.3825 | 95.82 | |
| SVDBackbone=RoBERTa-large, Client distribution=10-client non-IID, Number of seeds=32026.06 | 31.5 | 30.5 | 31.4 | 1.3836 | 99.12 |