fMNIST
Benchmarks
TaskDatasetSOTA resultTrendResults
FMNIST original (test)
0.1Original Error Rate
16
fMNIST (test)
0.005MSE (Reconstruction Error)
15
FMNIST (Shards)
100RES
14
FMNIST (Dirichlet)
100RES
14
FMNIST IID
100RES
14
FMNIST i.i.d. (test)
75.81Accuracy
14
FMNIST (Dir(0.5))
93.11Accuracy
13
FMNIST (Dir(0.1))
96.89Accuracy
13
FMNIST
86.7Accuracy
13
FMNIST
0INFD
13
FMNIST (test)
100ARI
12
FMNIST N = 50 (test)
1.74Max Latency
12
FMNIST
85.8CTA Score
12
FMNIST (test)
89.02Accuracy (alpha=0.1)
12
FMNIST
0.001Communication Cost (GB)
12
FMNIST label shift (test)
72.66Top-1 Accuracy
12
FMNIST
58.82System Accuracy
11
FMNIST Extreme non-i.i.d.
2.44Global Cycles to 30% Acc
10
FMNIST Mild non-i.i.d.
2.64Global Cycles to 51% Acc
10
FMNIST
0.47NLL
10
FMNIST non-i.i.d. (test)
70.83Accuracy (Test)
10
FMNIST (train)
69.24Speedup
10
FMNIST ID (test)
3.26ECE
9
FMNIST
83.2Accuracy (alpha=0.1)
9
fMNIST (train)
0.003Loss
9