Image Classification on Oxford Flowers 102 WRN16 (test)
88.04AccuracySystem-aware Biased Local SGD
Evaluation results
| Method | Links | |
|---|---|---|
| System-aware Biased Local SGDEpochs=900, Comm. per epoch=2, Wall-clock Time (sec)=3249.34, Hardware=2-CPU + 8-GPU, Backbone=WRN162025.08 | 88.04 | |
| BytePSEpochs=300, Comm. per epoch=80, Wall-clock Time (sec)=3091.76, Hardware=2-CPU + 8-GPU, Backbone=WRN162025.08 | 86.67 | |
| Synchronous SGD + Data-ParallelismEpochs=300, Comm. per epoch=80, Wall-clock Time (sec)=2866.08, Hardware=8-GPU only, Backbone=WRN162025.08 | 85.88 | |
| System-aware Biased Local SGDEpochs=600, Comm. per epoch=2, Wall-clock Time (sec)=2166.22, Hardware=2-CPU + 8-GPU, Backbone=WRN162025.08 | 85.29 | |
| Synchronous SGD + Data-ParallelismEpochs=300, Comm. per epoch=64, Wall-clock Time (sec)=34659.58, Hardware=2-CPU + 8-GPU, Backbone=WRN162025.08 | 84.75 | |
| DLBEpochs=300, Comm. per epoch=64, Wall-clock Time (sec)=2292.87, Hardware=2-CPU + 8-GPU, Backbone=WRN162025.08 | 76.52 | |
| System-aware Biased Local SGDEpochs=300, Comm. per epoch=2, Wall-clock Time (sec)=1083.11, Hardware=2-CPU + 8-GPU, Backbone=WRN162025.08 | 73.09 | |
| Balanced Local SGDEpochs=300, Comm. per epoch=2, Wall-clock Time (sec)=33497.26, Hardware=2-CPU + 8-GPU, Backbone=WRN162025.08 | 69.51 |