fMNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
FMNIST (Non-IID 2)
89.28Accuracy
4
FMNIST (Non-IID 1)
91.44Accuracy
4
FMNIST (IID)
92.24Accuracy
4
FMNIST
52Runtime (ms)
4
FMNIST
288.39FID
4
MoE-FMNIST (test)
87.39Accuracy
3
FMNIST
102.21Sinkhorn Divergence
3
FMNIST Even (test)
97.87Accuracy
3
FMNIST [0,2,3,7,8] (ID) vs [1,4,5,6,9] (OOD)
95AUROC
3
FMNIST Cross-Device, 100 clients
100Average TPR
2
FMNIST Cross-Silo, 10 clients
100Average TPR
2
FMNIST
0.01Local Average Distance (AD)
2
FMNIST
89.08Accuracy After Unlearning
1
FMNIST standard (test)
—IID Error Rate
0
fMNIST (test)
—Primary metric
0