CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100
15.65Error Rate
16
CIFAR100 (B=2, C=2) (test)
78Average Accuracy
16
CIFAR100 (B=5, C=5) (test)
78Avg Acc
16
CIFAR-10 (test)
89.54SA Score
16
CIFAR-100 Symmetric Noisy Labels, r=0.6
43.9Accuracy
16
CIFAR-100 Symmetric Noisy Labels, r=0.4
54.7Accuracy
16
CIFAR-100 standard (test)
49.18Accuracy (Standard)
16
CIFAR-10 standard (test)
77.12Vanilla Accuracy
16
CIFAR-10 (test)
61.88Robust Accuracy (PGD-20)
16
CIFAR-10
25.34Time/epoch (s)
16
CIFAR-100 50% known, 50% novel
74.1Known Accuracy
16
CIFAR-100N Fine
73.79Accuracy
16
CIFAR-10 AdvP
70.81Accuracy
16
CIFAR-10 AdvL
98.67Accuracy
16
CIFAR-100 PGD-10 (l_2, 128/255) 1.0
0.483TPR-95
16
CIFAR-100 PGD-10 (l_inf, 16/255) 1.0
22.2TPR-95
16
CIFAR-100 PGD-10 (l_inf, 8/255) 1.0
38.81TPR-95
16
CIFAR-100
23.01ASR
16
CIFAR-100
31.39ASR
16
CIFAR-100
98.5Final Auto-Attack Accuracy
16
CIFAR-100
66.9Seen Accuracy
16
CIFAR-100
98.5AUROC (SVHN)
16
CIFAR-100+ (test)
17.18Error Rate
16
CIFAR-10 data-augmented (+) (test)
96.7Accuracy
16
CIFAR-10 Corruption avg (test)
58AUROC
16