MNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MNIST -> USPS (test)
0.985Accuracy
28
MNIST 2Classes
99.97Accuracy
27
MNIST (train)
-330.996Log Likelihood
27
MNIST
96.82GM
27
MNIST (test)
99.45Certified Accuracy (r=0.00)
27
MNIST (test)
1.823Overall ACR
27
MNIST (test)
42.7Average Time (s)
27
MNIST
100Detection Accuracy
26
Split-MNIST
94Final Mean Accuracy
26
MNIST (full)
99.27Accuracy
26
MNIST to USPS
96Accuracy
26
PI-MNIST (test)
0.008Classification Error
26
MNIST Binary
4.62FID
25
MNIST standard (test)
99.96ASR
25
MNIST
97.47ASR
25
MNIST digits 8 and 9
99.2AUC
25
MNIST digits 8, 9 n=10000 (unlabeled points)
0.01Average Run Time (s)
25
MNIST Split
99.42Avg Accuracy
25
MNIST iid (10 classes/client) CONV4, 50 rounds (test)
99.4Accuracy
25
sMNIST
99.75Accuracy
25
sub-MNIST (test)
4.56Misclassification Rate
25
MNIST (test)
77.4Robustness Score
25
MNIST to MNIST-M (test)
98.91Accuracy
25
MNIST
0.98LeNet-FID
24
MNIST 7-class
80.43Accuracy
24