FEMNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
FEMNIST (Natural split)
0.41Average Pearson Correlation
5
FEMNIST (Natural split)
61.17Accuracy
5
FEMNIST (test)
76.24Top 10% Most Samples Accuracy
5
FEMNIST (Non-IID 2)
80.32Accuracy
4
FEMNIST (Non-IID 1)
81.12Accuracy
4
FEMNIST IID
80.24Accuracy
4
FEMNIST
79.37Accuracy
4
FEMNIST FedAvg 0.8235 (test)
81.45Accuracy
4
FEMNIST LEAF (test)
71.84Personalization Accuracy
3
FEMNIST unseen clients (test)
79.1Test Accuracy
3
FEMNIST LEAF (non-i.i.d.)
—Accuracy
0