CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR10
83.2Accuracy
7
CIFAR-10 non-i.i.d. (test)
88Test Accuracy (rho=0.4, tau=0.3)
7
CIFAR-100
74.02Base Accuracy
7
CIFAR-100 alpha=0.1 (test)
45Steps to 30% Accuracy
7
CIFAR-100 personalized (test)
66.32Client 1 Accuracy
7
CIFAR-100 20 clients (personalized)
67.41Client 1 Accuracy
7
CIFAR-100 S4 search space (test)
20.8Error Rate
7
CIFAR-100 S3 search space (test)
0.211Error Rate
7
CIFAR-100 S2 search space (test)
21.61Error Rate (%)
7
CIFAR-10 S3 search space (test)
2.42Error Rate
7
CIFAR-10 S2 search space (test)
2.49Error Rate
7
CIFAR-10
31.75Top-1 Error (FGSM, eps=8/255)
7
CIFAR-100 class wolf (test)
76.38Accuracy Retention (Ar)
7
CIFAR-100 class DINO (test)
76.55Utility Ar
7
CIFAR-100 class sea (test)
76.35Utility (Ar)
7
CIFAR-100 class lamp (test)
76.5Ar (Accuracy Retention)
7
CIFAR-100 class baby (test)
76.7Utility (Ar)
7
CIFAR-10 pixel space (test)
3.16FID
7
CIFAR-100
0.46AULC (alpha=0.1)
7
CIFAR-10
2.919AULC (alpha=0.1)
7
CIFAR-10 Class imbalance Standard
56.54Accuracy
7
CIFAR-10 Schematic confusion Standard
58.65Accuracy
7
CIFAR-10 80% flips Standard
0.566Accuracy
7
CIFAR-10 40% flips Standard
66.23Accuracy
7
CIFAR-100 Schematic confusion (test)
21.76Accuracy
7