Fashion MNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Fashion-MNIST
91.14Clean Accuracy
7
Fashion-MNIST Non-binarized original (test)
174.57Log-Likelihood Bound
7
Fashion-MNIST dynamically binarized (test)
-239.11Log-Likelihood Bound (100-point)
7
Fashion-MNIST 10k raw-pixel
57.6Accuracy
7
Fashion-MNIST
81.19Accuracy
7
Fashion-MNIST (F-MNIST) (test)
127Model Size (kB)
7
Fashion-MNIST class-prior shift ρ=100, μ=0.5 (test)
74.25Accuracy
6
Fashion-MNIST class-prior shift ρ=50, μ=0.5 (test)
78.09Accuracy
6
Fashion-MNIST Label Skew K=3
91.72Top-1 Accuracy
6
Fashion-MNIST Label Skew K=2
92.64Top-1 Accuracy
6
Fashion-MNIST Label Skew K=1
94.14Top-1 Accuracy
6
Fashion-MNIST Dirichlet alpha=0.1
82.47Top-1 Acc
6
Fashion-MNIST Dirichlet alpha=0.5
88.42Top-1 Accuracy
6
Fashion-MNIST Dirichlet alpha=0.8
88.17Top-1 Accuracy
6
Fashion-MNIST IID (test)
79.9LF Attack (10% Ratio)
6
Fashion-MNIST large setting
2.431Runtime (s)
6
Fashion-MNIST small setting
0.012Runtime (seconds)
6
Fashion MNIST
15.65T-shirt Accuracy
6
Fashion MNIST
60.5T-shirt Score
6
Fashion-MNIST (test)
98.93Accuracy
6
Fashion-MNIST alpha = 0.1
6Communication Rounds
6
Fashion-MNIST alpha=0.1 (test)
65.76Accuracy
6
Fashion-MNIST (FMNIST) (test)
4.29Bits Per Pixel
6
Fashion-MNIST
3,832Operational Score
6
Fashion MNIST
78.82Accuracy
6