CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100 (second class split)
63.5Session 1 Accuracy
5
CIFAR-10 CIFAR-100
64AUROC
5
CIFAR10 Imbalance (test)
66.88Top-1 Acc (10%)
5
CIFAR10 OOD (test)
0.793Top-1 Acc (25%)
5
CIFAR-10 L-infinity, epsilon=8/255
62.8Robust Acc (AA)
5
CIFAR-100 standard (test)
76.77SVHN FPR95
5
CIFAR-100 unlabeled (test)
0.84AUROC
5
CIFAR-10 (in) CIFAR-100 (out)
98.52Mahalanobis AUROC
5
CIFAR-100 (in) CIFAR-10 (out)
0.962Mahalanobis AUROC
5
CIFAR-100 long-tail (imbalance ratio 100) (test)
48.9Average Recall
5
CIFAR10 Resnet18 (test)
93Accuracy
5
CIFAR10
1.74FID
5
CIFAR-100 10000 labels standard
32Error Rate
5
CIFAR-100 4000 labels standard
32.77Error Rate
5
CIFAR100 10 classes, 300 samples per class
35.23FID
5
CIFAR-100 Meta-Dataset (unseen)
35.1Recall@1
5
CIFAR-10 Meta-Dataset (unseen)
66.2Recall@1
5
CIFAR10 (test)
1.7Average Rank
5
CIFAR-10 40% Mixed noise: A-20, S-20
86.1Accuracy
5
CIFAR-10 40% Mixed noise: A-30, S-10
85.7Accuracy
5
CIFAR-10 symmetric noise all labels
95.6Accuracy
5
CIFAR-10 (ID) vs Uniform (OOD)
100AUROC
5
CIFAR-10-C level 1 (test)
7.9Error (Original)
5
CIFAR-10-C level 4 (test)
7.9Error Rate (Baseline)
5
CIFAR-10-C level 2 (test)
16.5Baseline Score
5