CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100-C
43.15mCE
8
CIFAR-10 PGD-10, l2, ε=128/255 (test)
72TPR-95
8
CIFAR-10 PGD-10, l∞, ε=16/255 (test)
37.63TPR-95
8
CIFAR-10 PGD-10, l∞, ε=8/255 (test)
61.48TPR-95
8
CIFAR-100-P
12Consistency
8
CIFAR-10-LT λ=200 (test)
23.11Error Rate
8
CIFAR-10 (test)
99.2Top-1 Accuracy
8
CIFAR-100 (test)
68.89Symmetric 20% Acc
8
CIFAR-100 (test)
79.27Accuracy (Clean)
8
CIFAR-10 (test)
95.91Accuracy (No Noise 0%)
8
CIFAR10
0.33NLL
8
CIFAR-10 (i.i.d.)
20.82Test Error
8
CIFAR-100 Noisy 100 clients (test)
-2.8Relative Accuracy Decrease (%)
8
CIFAR-10 (val)
0.044Top-1 Error
8
CIFAR-10
100AUROC (iSUN)
8
CIFAR-100
99.3AUROC (iSUN)
8
CIFAR-10
100TNR@TPR95% (ISUN)
8
CIFAR-10
99.92AUROC (SVHN)
8
CIFAR-10 (test)
84.52Clean Accuracy
8
Human CIFAR-10 (test)
90.62Accuracy
8
CIFAR-10 4000 labels standard
6.39Error Rate
8
CIFAR-100 (test)
72.22Accuracy (ε=0.4)
8
CIFAR-10 (test)
95.18Accuracy (ε=0.2)
8
CIFAR-10 (test)
4.9Top-1 Error Rate (IR-NR 1-0.0)
8
CIFAR-100 (IR=1, NR=0.1) (test)
27.3Top-1 Error Rate
8