Decentralized Training on SST-2, RTE, and BoolQ (OPT-125m backbone)
101.49Normalized PerformanceDSGD
Evaluation results
| Method | Links | |
|---|---|---|
| DSGD#Clients=64, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 101.49 | |
| DSGD#Clients=32, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 100.82 | |
| DSGD#Clients=32, Network Topology=Ring, Backbone=OPT-125m2026.02 | 100.57 | |
| DSGD-LoRA#Clients=64, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 100.56 | |
| SeedFlood#Clients=128, Network Topology=Ring, Backbone=OPT-125m2026.02 | 100.24 | |
| DSGD-LoRA#Clients=16, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 100.16 | |
| DSGD#Clients=16, Network Topology=Ring, Backbone=OPT-125m2026.02 | 100 | |
| DSGD#Clients=16, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 100 | |
| ChocoSGD#Clients=16, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 99.04 | |
| DSGD-LoRA#Clients=32, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 98.92 | |
| ChocoSGD#Clients=16, Network Topology=Ring, Backbone=OPT-125m2026.02 | 98.59 | |
| ChocoSGD#Clients=32, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 98.53 | |
| DSGD-LoRA#Clients=32, Network Topology=Ring, Backbone=OPT-125m2026.02 | 98.4 | |
| SeedFlood#Clients=32, Network Topology=Ring, Backbone=OPT-125m2026.02 | 98.2 | |
| DSGD-LoRA#Clients=16, Network Topology=Ring, Backbone=OPT-125m2026.02 | 97.91 | |
| SeedFlood#Clients=32, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 97.64 | |
| ChocoSGD#Clients=32, Network Topology=Ring, Backbone=OPT-125m2026.02 | 97.52 | |
| SeedFlood#Clients=128, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 97.51 | |
| SeedFlood#Clients=64, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 97.3 | |
| DSGD#Clients=128, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 96.56 | |
| DSGD#Clients=64, Network Topology=Ring, Backbone=OPT-125m2026.02 | 96.24 | |
| SeedFlood#Clients=16, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 96.2 | |
| DSGD-LoRA#Clients=128, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 95.83 | |
| SeedFlood#Clients=64, Network Topology=Ring, Backbone=OPT-125m2026.02 | 95.81 | |
| ChocoSGD#Clients=64, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 94.65 | |
| DSGD#Clients=128, Network Topology=Ring, Backbone=OPT-125m2026.02 | 94.5 | |
| SeedFlood#Clients=16, Network Topology=Ring, Backbone=OPT-125m2026.02 | 94.38 | |
| ChocoSGD#Clients=64, Network Topology=Ring, Backbone=OPT-125m2026.02 | 94.13 | |
| ChocoSGD#Clients=128, Network Topology=Ring, Backbone=OPT-125m2026.02 | 92.97 | |
| ChocoSGD#Clients=128, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 92.97 | |
| ChocoSGD-LoRA#Clients=16, Network Topology=Ring, Backbone=OPT-125m2026.02 | 91.19 | |
| ChocoSGD-LoRA#Clients=32, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 90.3 | |
| ChocoSGD-LoRA#Clients=16, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 89.49 | |
| ChocoSGD-LoRA#Clients=128, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 87.84 | |
| ChocoSGD-LoRA#Clients=64, Network Topology=Meshgrid, Backbone=OPT-125m2026.02 | 86.44 | |
| DSGD-LoRA#Clients=64, Network Topology=Ring, Backbone=OPT-125m2026.02 | 81.27 | |
| ChocoSGD-LoRA#Clients=32, Network Topology=Ring, Backbone=OPT-125m2026.02 | 80.32 | |
| ChocoSGD-LoRA#Clients=64, Network Topology=Ring, Backbone=OPT-125m2026.02 | 76.88 | |
| DSGD-LoRA#Clients=128, Network Topology=Ring, Backbone=OPT-125m2026.02 | 76.41 | |
| ChocoSGD-LoRA#Clients=128, Network Topology=Ring, Backbone=OPT-125m2026.02 | 75.55 |