MNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MNIST (Hard)
95.06Token Accuracy
5
MNIST Medium
97.65Token Accuracy
5
MNIST Medium
98.34Token Accuracy (%)
5
MNIST Medium
92.15Token Accuracy
5
MNIST Medium
0.979Token Accuracy
5
MNIST Easy
99.04Token Accuracy
5
MNIST Easy
99.41Token Accuracy
5
MNIST Easy
97.64Token Accuracy
5
MNIST (Easy)
99.27Token Accuracy
5
MNIST
92.667T-Statistic
5
MNIST
18.88T-Statistic
5
MNIST
97.8Utility AUC
5
MNIST
98Certified Accuracy (Rotation 30)
5
Hue-shift MNIST (A/B)
1.81Classification Error
5
Hue-shift MNIST (A A)
1.54Classification Error
5
MNIST K=4 sources (full)
13.98PSNR
5
MNIST
6.2Communication Overhead (MB)
5
MNIST
99.5Accuracy
5
MNIST SNR +10 dB 2,000 samples per SNR level (test)
-22.66NMSE (dB)
5
MNIST SNR +5 dB 2,000 samples per SNR level (test)
-21.09NMSE (dB)
5
MNIST SNR 0 dB 2,000 samples per level (test)
-18.3NMSE (dB)
5
MNIST SNR -5 dB (test)
-15.39NMSE (dB)
5
MNIST SNR -10 dB (test)
-12.83NMSE (dB)
5
Permuted MNIST p1, p2, p3 (test)
92.8Task 1 Accuracy
5
MNIST
98.3Fidelity (FT)
5