CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-20 Class-prior Shift 10 (test)
49.17Mean Accuracy
7
CIFAR-20 Label Noise 0.4 (test)
45.48Mean Accuracy
7
CIFAR-20 Label Noise 0.2 (test)
54.19Mean Accuracy
7
CIFAR-10
86.45Clean Accuracy
7
CIFAR-100 (test)
76.95Clean Accuracy
7
CIFAR-100 (val)
0.771Top-1 Error Rate
7
CIFAR 7to3 (test)
94.14Accuracy
7
CIFAR-100 LT (Imbalance ratio 200)
44.88Top-1 Acc
7
CIFAR-10-LT Imbalance ratio 200
79.03Top-1 Acc
7
CIFAR-100 super-classes (test)
0.948AUROC
7
CIFAR-10.2-C 50 (test)
10.127Severity 1 Score
7
CIFAR-100 20 (test)
75.9Accuracy (Label)
7
CIFAR-10-C severity level 5 (test)
75.98Accuracy (Weather)
7
CIFAR-10
83.3Accuracy (Watermark Patch)
7
CIFAR10 (test)
64.69Accuracy (Natural)
7
CIFAR-10 20% symmetric noise
0.96Accuracy
7
CIFAR-10
89.02ACC (Seen)
7
CIFAR10 Bernoulli shift
14.8Average Error
7
CIFAR10 Square shift (test)
14.84Average Error
7
CIFAR100 (test)
22.04Ex ||∇f(x)||^2
7
CIFAR-100 regular ND
98.1AUROC
7
CIFAR100 LT (Imbalance Ratio 10) long-tailed-backward (test)
62.9Top-1 Acc (Backward-LT IR=2)
7
CIFAR-10 In 1.0 (test)
0.93AUROC
7
CIFAR-100
0.866Weighted Kendall Tau
7
CIFAR-100 10% labeled data (test)
55Known Class Accuracy
7