FEMNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
FEMNIST (test)
97.31Accuracy
104
FEMNIST
92.56Accuracy
50
FEMNIST (LEAF) (test)
82.45Accuracy
39
FEMNIST natural partition (test)
76.3MIA Accuracy
24
FEMNIST (natural partition)
100PPS
20
FEMNIST C=10 original (test)
82.4Accuracy
17
FEMNIST (train)
72.72Accuracy
14
FEMNIST (test)
70.6Mean Accuracy
14
FEMNIST (non-iid)
84Accuracy
13
FEMNIST
24.18PSNR
12
FEMNIST realistic non-IID LEAF benchmark (test)
85.2Top-1 Acc
11
FEMNIST
398Average Unlearning Time (s)
10
FEMNIST LEAF
80.61Accuracy
10
FEMNIST Practical
100Mean Accuracy
9
FEMNIST 10 new writers (test)
88.18Overall Accuracy
9
FEMNIST
53.6MIA Accuracy
8
FEMNIST non-i.i.d.
14.76Test Error
8
FEMNIST i.i.d.
14.79Test Error Rate
8
FEMNIST non-i.i.d.
14.76Test Error Rate
8
FEMNIST (i.i.d.)
14.79Test Error
8
FEMNIST (test)
65.04Accuracy
7
FEMNIST (test)
80.6Accuracy (alpha=0.1)
7
FEMNIST 7 (test)
79.9Avg Accuracy
7
FEMNIST
73.5Clean Accuracy
6
FEMNIST Dir-0.1 (test)
86.3Accuracy
6