FashionMNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
FashionMNIST
24.91PSNR
10
FashionMNIST [0,2,3,7,8] (ID) vs [1,4,5,6,9] (OOD) (unlabeled set)
95AUROC
10
FashionMNIST
3.141Efficiency Rate
9
FashionMNIST IDN-50%
78.19Accuracy
9
FashionMNIST IDN-45%
88.75Accuracy
9
FashionMNIST IDN-40%
90.01Accuracy
9
FashionMNIST IDN-30%
90.68Accuracy
9
FashionMNIST IDN-20%
91.58Accuracy
9
FashionMNIST (Weak Non-IID)
88.74Accuracy
8
FashionMNIST Strong Non-IID
88.55Accuracy
8
FashionMNIST linf, epsilon=0.3 (test)
96.34Robust Accuracy (FGSM)
8
FashionMNIST (l2, epsilon=2) (test)
82.91PGD (100) Robust Accuracy
8
FashionMNIST l1, epsilon=10 (test)
92.56Clean Accuracy
8
FASHIONMNIST
12.6Empirical Risk
8
FashionMNIST (ID) vs Rotation (avg) (OoD)
79AUROC
8
FASHIONMNIST vs Rotation (test)
0.9AUROC
8
FashionMNIST
66.1Average Drop (AD)
7
FashionMNIST imbalanced
93.82Macro Precision
7
FashionMNIST imbl
93.82Macro Precision
7
FashionMNIST
90.61Accuracy
7
FashionMNIST
0.941Accuracy
6
FashionMNIST
92.73Mean Client Accuracy (alpha=0.1)
6
FashionMNIST INR
62.11Accuracy
6
FashionMNIST-10 (test)
72.11Test Accuracy
6
FashionMNIST (test)
90.6Accuracy
5