CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100 (test)
78.4Clean Accuracy
3
CIFAR10 ID Mean OOD (test)
43.74FPR@95
3
CIFAR-100
78.52Victim Accuracy
3
CIFAR-100
0.61Perturbation Magnitude (Normal)
3
CIFAR-100
8.58Min Perturbation (Normal)
3
CIFAR-10
0.87Min Perturbation (Normal)
3
CIFAR-10
14.99Minimal Perturbation (Normal)
3
CIFAR100 [0:49] (ID) vs [50:99] (OOD)
90AUROC
3
CIFAR10 [0:4] (ID) vs [5:9] (OOD)
0.97AUROC
3
CIFAR10.1 (test)
90.64Accuracy
3
CIFAR10
25.39Avg Execution Time (ms)
3
CIFAR10
26.26Avg Query Time (ms)
3
CIFAR-10 standard (test)
94.78Accuracy (0% noise)
3
CIFAR-10
643.31FID
3
CIFAR-100 (test)
94.73Fine-tuned Test Accuracy
3
CIFAR-100 (test)
10.16FID
3
CIFAR100 50 steps B0 (test)
70.58Accuracy
3
CIFAR-10 (In-Distribution) vs CIFAR-10-C (OOD-2) (test)
0.63Avg AUROC
3
CIFAR-10 (In-Distribution) vs OOD-1 (Out-of-Distribution suite) (test)
0.7AUROC (DTD)
3
CIFAR-10 Error Rate e=0.4
83.81Accuracy
3
CIFAR-10 Error Rate e=0.2
87.72Accuracy
3
CIFAR-10 with TinyImageNet (TIN) as OOD (test)
86.44Test Accuracy
3
CIFAR-10 (ID) vs TIN (OOD)
98.86AUROC
3
CIFAR100 coarse-grained (test)
0.893ROC AUC
3
CIFAR100
9.56Inception Score
3