MNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MNIST
80.58Class Accuracy
9
MNIST basic (test)
1.05Error Rate
9
MNIST
0.183Loss
9
MNIST (test)
0.71Error Rate
9
MNIST (train)
50.702Train CE Loss
9
MNIST
142Communication Rounds
8
MNIST 6 known and 4 unknown classes
99.9AUROC
8
MNIST (test)
99.02Accuracy
8
MNIST K=64 (test)
69.17Objective Score
8
MNIST K=64 (train)
28.31Objective
8
MNIST K=64 (test)
4.98Reconstruction Error (MSE)
8
MNIST Label-Switching (test)
95.31Accuracy (Test)
8
MNIST label-swapped
10.32Accuracy
8
MNIST Dir(0.5) (test)
89.1Test Accuracy
8
MNIST Dir(0.1) (test)
94.22Test Accuracy
8
MNIST Dir(0.05) (test)
95.12Test Accuracy
8
MNIST
6.13Clock Time (ns)
8
mnist
1Test Power
8
MNIST 2 Source Mixtures (test)
37.44PSNR
8
MNIST (test)
0.947Pearson Correlation
8
MNIST
15.1FID
8
MNIST LeNet (test)
97.42Accuracy
8
MNIST 7-vs-9 (test)
0.057Test MSE
8
MNIST 20/20
100TPR
8
MNIST (Weak Non-IID)
98.88Accuracy
8