CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100 80% label flips (test)
17.52Accuracy
7
CIFAR-100 40% label flips (test)
0.193Accuracy
7
CIFAR100
26.49Data Transmission Volume (GB)
7
CIFAR10
2.9Total Volume (GB)
7
CIFAR-10 (Aggregate (IID & Non-IID))
87.05Average Model Accuracy
7
CIFAR-10 alpha=0.5 (Non-IID)
85.74MA
7
CIFAR-10 Average alpha Neurotoxin attack (test)
87.88MA
7
CIFAR-10 alpha=0.7 Neurotoxin attack Round 2001 100 rounds (test)
87.53Mean Accuracy
7
CIFAR-10 alpha=0.5 Neurotoxin attack, Round 2001, 100 rounds (test)
87.85MA
7
CIFAR-10 alpha=0.2 Neurotoxin attack Round 2001 100 rounds (test)
88.26Mean Accuracy
7
CIFAR100
81.02Accuracy
7
CIFAR-10
5.16FID
7
CIFAR-10 Split (test)
70.2Mean BWT
7
CIFAR10 (test)
0.006MSE
7
CIFAR10
83.85FRL Accuracy
7
CIFAR-100 Split (test)
94.07FAA
7
CIFAR-10
5,224Estimated Clusters
7
CIFAR100
88.2Accuracy
7
CIFAR-10 (test)
91.18Clean Accuracy
7
CIFAR-10 Overall (Combined Shift Regimes) Final aggregate (test)
62.85AUROC
7
CIFAR-10 Adversarial FGSM, PGD, and AutoAttack averages (test)
61.44AUROC
7
CIFAR-10
0.004Distribution Time (s)
7
CIFAR-100-R (test)
99.22Sensor Failure AUROC
7
CIFAR100
72.32Accuracy
7
CIFAR100
1SSIM
7