EMNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
EMNIST Dir. (0.01) 47 classes
0.824Test Accuracy
5
Emnist-Letters Non-IID L
90Accuracy
5
Emnist-Digits Non-IID D
99.1Convergence Accuracy
5
Emnist-Digits IID D
99.43Accuracy (Convergence)
5
EMNIST
6.23Communication Overhead (MB)
5
EMNIST Non-IID (Dirichlet alpha = 0.8)
86.91Accuracy
5
EMNIST (IID)
0.983Accuracy
5
EMNIST
0.031Latency (s)
5
EMNIST Digits (test)
99.75Accuracy (Avg)
5
EMNIST (full)
73.2ACC
5
EMNIST Scattered
74.4ACC
5
EMNIST
81.3AUBC
4
EMNIST
12.06Verification Overhead (s)
4
EMNIST balanced mixed noise (train)
91.27Accuracy
4
EMNIST balanced mixed noise (test)
89.32Accuracy
4
EMNIST
314Runtime (ms)
4
EMNIST Letters
95.933Best Leaderboard Accuracy
4
eMNIST (test)
-304.96Log Likelihood (AIS)
4
EMNIST
90.32AUROC
3
EMNIST letters (test)
93.21Accuracy (Clean)
3
EMNIST (val)
15Rounds to 20.0% Accuracy
3
EMNIST balanced clean (train)
91.9Accuracy
3
EMNIST balanced clean (test)
89.58Accuracy
3
EMNIST
575.39Estimated Clusters
3
EMNIST Letters
95.96Accuracy
3