Image Classification on CIFAR10 (test) (Top-1 Accuracy)
99.2Top-1 AccuracyViT-B/16
Evaluation results
| Method | Links | |
|---|---|---|
| ViT-B/16Pretraining + MaskSub=true, Finetuning + MaskSub=false2023.06 | 99.2 | |
| ViT-B/16Pretraining + MaskSub=false, Finetuning + MaskSub=false2023.06 | 99.1 | |
| ViT-S/16Pretraining + MaskSub=true, Finetuning + MaskSub=false2023.06 | 98.9 | |
| ViT-S/16Pretraining + MaskSub=false, Finetuning + MaskSub=false2023.06 | 98.8 | |
| ViT-S/16Pretraining + MaskSub=true, Finetuning + MaskSub=true2023.06 | 98.8 | |
| ViT-B/16Pretraining + MaskSub=true, Finetuning + MaskSub=true2023.06 | 98.8 | |
| OrLoMoScenario=heterogeneous, Workers=8, Local Iterations=8, Backbone=SqueezeNet2026.01 | 92.34 | |
| PRSGDmScenario=homogeneous, Workers=8, Local Iterations=8, Backbone=SqueezeNet2026.01 | 92.18 | |
| local OrMo-DAScenario=heterogeneous, Workers=8, Local Iterations=8, Backbone=SqueezeNet2026.01 | 92.18 | |
| OrLoMoScenario=homogeneous, Workers=8, Local Iterations=8, Backbone=SqueezeNet2026.01 | 92.11 | |
| OrLoMoScenario=homogeneous, Workers=8, Local Iterations=16, Backbone=SqueezeNet2026.01 | 92.11 | |
| PRSGDmScenario=heterogeneous, Workers=8, Local Iterations=8, Backbone=SqueezeNet2026.01 | 92.06 | |
| local OrMo-DAScenario=homogeneous, Workers=8, Local Iterations=8, Backbone=SqueezeNet2026.01 | 92.02 | |
| PRSGDmScenario=homogeneous, Workers=16, Local Iterations=8, Backbone=SqueezeNet2026.01 | 92 | |
| OrLoMoScenario=heterogeneous, Workers=8, Local Iterations=32, Backbone=SqueezeNet2026.01 | 91.96 | |
| PRSGDmScenario=heterogeneous, Workers=16, Local Iterations=8, Backbone=SqueezeNet2026.01 | 91.88 | |
| OrLoMoScenario=homogeneous, Workers=8, Local Iterations=32, Backbone=SqueezeNet2026.01 | 91.85 | |
| OrLoMoScenario=heterogeneous, Workers=8, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.76 | |
| PRSGDmScenario=homogeneous, Workers=8, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.67 | |
| PRSGDmScenario=heterogeneous, Workers=8, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.66 | |
| local OrMo-DAScenario=heterogeneous, Workers=8, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.64 | |
| PRSGDmScenario=heterogeneous, Workers=8, Local Iterations=32, Backbone=SqueezeNet2026.01 | 91.61 | |
| OrLoMoScenario=heterogeneous, Workers=16, Local Iterations=8, Backbone=SqueezeNet2026.01 | 91.61 | |
| OrLoMoScenario=heterogeneous, Workers=16, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.5 | |
| AL-SGDScenario=homogeneous, Workers=8, Local Iterations=8, Backbone=SqueezeNet2026.01 | 91.46 | |
| local OrMo-DAScenario=heterogeneous, Workers=16, Local Iterations=8, Backbone=SqueezeNet2026.01 | 91.45 | |
| OrLoMoScenario=homogeneous, Workers=16, Local Iterations=8, Backbone=SqueezeNet2026.01 | 91.39 | |
| PRSGDmScenario=homogeneous, Workers=8, Local Iterations=32, Backbone=SqueezeNet2026.01 | 91.37 | |
| local OrMo-DAScenario=homogeneous, Workers=8, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.36 | |
| PRSGDmScenario=homogeneous, Workers=16, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.29 | |
| OrLoMoScenario=homogeneous, Workers=16, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.27 | |
| AL-SGDScenario=heterogeneous, Workers=8, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.15 | |
| local OrMo-DAScenario=homogeneous, Workers=16, Local Iterations=8, Backbone=SqueezeNet2026.01 | 91.14 | |
| AL-SGDScenario=heterogeneous, Workers=8, Local Iterations=8, Backbone=SqueezeNet2026.01 | 91.13 | |
| PRSGDmScenario=heterogeneous, Workers=16, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.08 | |
| OrLoMoScenario=homogeneous, Workers=16, Local Iterations=32, Backbone=SqueezeNet2026.01 | 91.05 | |
| AL-SGDScenario=homogeneous, Workers=8, Local Iterations=16, Backbone=SqueezeNet2026.01 | 91.01 | |
| AL-SGDScenario=heterogeneous, Workers=8, Local Iterations=32, Backbone=SqueezeNet2026.01 | 90.88 | |
| local OrMo-DAScenario=heterogeneous, Workers=8, Local Iterations=32, Backbone=SqueezeNet2026.01 | 90.83 | |
| AL-SGDScenario=homogeneous, Workers=8, Local Iterations=32, Backbone=SqueezeNet2026.01 | 90.82 | |
| OrLoMoScenario=heterogeneous, Workers=16, Local Iterations=32, Backbone=SqueezeNet2026.01 | 90.73 | |
| PRSGDmScenario=heterogeneous, Workers=16, Local Iterations=32, Backbone=SqueezeNet2026.01 | 90.41 | |
| AL-SGDScenario=homogeneous, Workers=16, Local Iterations=8, Backbone=SqueezeNet2026.01 | 90.26 | |
| local OrMo-DAScenario=heterogeneous, Workers=16, Local Iterations=16, Backbone=SqueezeNet2026.01 | 90.23 | |
| PRSGDmScenario=homogeneous, Workers=16, Local Iterations=32, Backbone=SqueezeNet2026.01 | 90.1 | |
| local OrMo-DAScenario=homogeneous, Workers=8, Local Iterations=32, Backbone=SqueezeNet2026.01 | 90.02 | |
| AL-SGDScenario=heterogeneous, Workers=16, Local Iterations=8, Backbone=SqueezeNet2026.01 | 90.02 | |
| AL-SGDScenario=homogeneous, Workers=16, Local Iterations=16, Backbone=SqueezeNet2026.01 | 89.85 | |
| AL-SGDScenario=heterogeneous, Workers=16, Local Iterations=16, Backbone=SqueezeNet2026.01 | 89.85 | |
| AL-SGDScenario=heterogeneous, Workers=16, Local Iterations=32, Backbone=SqueezeNet2026.01 | 89.31 | |
| AL-SGDScenario=homogeneous, Workers=16, Local Iterations=32, Backbone=SqueezeNet2026.01 | 89.21 | |
| local OrMo-DAScenario=homogeneous, Workers=16, Local Iterations=16, Backbone=SqueezeNet2026.01 | 89.08 | |
| local OrMo-DAScenario=heterogeneous, Workers=16, Local Iterations=32, Backbone=SqueezeNet2026.01 | 83.45 | |
| local OrMo-DAScenario=homogeneous, Workers=16, Local Iterations=32, Backbone=SqueezeNet2026.01 | 77.96 |