CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-10 32x32
16.75Training Time (s)
4
CIFAR-100
37Accuracy (Seen Classes)
4
CIFAR-10
88.36Accuracy
4
CIFAR-10 Truck
38.1Delta UA
4
CIFAR-10 Horse
42.24Delta Utility (∆UA)
4
CIFAR-10 Dog
0∆UA
4
CIFAR-10 Cat
72.42Delta UA
4
Cifar100
22.28Running Time
4
Cifar100
90.61Accuracy
4
CIFAR10-C 10 rounds
14.15Error (%)
4
CIFAR-100 (test)
100Consistency
4
CIFAR-10
78Accuracy
4
CIFAR-10 10,000 labels
49Pinwheel Acc
4
CIFAR-10 Combined Heterogeneity, C=3 (test)
93.5Accuracy
4
CIFAR-10 Covariate Shift, K=3 (test)
98.1Accuracy
4
CIFAR-10 Label Shift, K=5 (test)
92.9Accuracy
4
CIFAR100 T=25
69.35Last Accuracy
4
CIFAR100 T=20
69.81Last Accuracy
4
CIFAR-10N (random)
97.39Accuracy
4
CIFAR-100 AutoAugment Base 50 Inc 10
69.42Last Accuracy
4
CIFAR-100 AutoAugment (Base 0 Inc 10)
68.86Last Accuracy
4
CIFAR10 t = 4 (test)
93.41Accuracy (%)
4
CIFAR100
7.14Advantage
4
CIFAR10
5.07Advantage
4
CIFAR-10 heterogeneous (test)
80.3Test Accuracy
4