MNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MNIST large
94.5L2 Certified Robustness
2
MNIST
2.18RMSE
2
MNIST
96.8MA
2
MNIST task4 (test)
93.5Average Accuracy
2
MNIST task3 (test)
93Accuracy
2
MNIST task2 (test)
89.3Average Accuracy
2
MNIST task1 (test)
89.1Average Accuracy
2
MNIST-ADD
94Mean ROC-AUC
2
MNIST averaged across 45 binary pairs
94Clean Accuracy
2
MNIST
-67.7Delta MSE (%)
2
PS-MNIST
94.3Accuracy
2
mnist_784
97.8Accuracy
2
MNIST
99.7Accuracy (Mean)
2
MNIST (test)
0.986SSIM
2
MNIST
31.2PSNR (dB)
2
MNIST Low data N=3000
15FID
2
MNIST N=1000 clients
13ARI
2
MNIST (test)
98.18Mean Accuracy
2
MNIST (test)
91.4Digit Accuracy
2
MNIST
1.85Latency (µs)
2
MNIST
93.7Accuracy
2
MNIST
0.94Theta (rad)
2
MNIST ori unrobust
76PAR2 Runtime
2
MNIST ori robust
108.76PAR2 Runtime
2
Inverse MNIST
-1,529.7Negative Log Likelihood
2