CIFAR-10
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-10 uniformly dequantized (test)
3.02Bits/Dim
8
CIFAR-10 intact (test)
93Coverage
8
CIFAR-10-P
3.7Consistency
8
CIFAR-10-C
9.5mCE
8
CIFAR-10 LT λ=20 (test)
12.36Error Rate
8
CIFAR-10 (test)
0.924Symmetric 20% Acc
8
Corrupted CIFAR-10 unbiased (test)
34.18Accuracy
8
Corrupted CIFAR-10 Type 1 unbiased (test)
59.3Accuracy
8
Corrupted CIFAR-10 Type 0 unbiased (test)
60.18Accuracy
8
CIFAR-10 Mixed OOD Distribution (test)
96.88AUROC
8
CIFAR-10 long-tailed (test)
19.08Balanced Error Rate
8
CIFAR-10 (test)
93.76Acc (ε=0.4)
8
CIFAR-10 (test)
88.1Greyscale Acc
8
CIFAR-10 Asymmetric Noise (train)
98.3Recovery Acc (10% noise)
8
CIFAR-10
4.31Bits per Pixel
8
Rotated CIFAR-10 (test)
79.7Overall Accuracy
7
CIFAR-10 ST-100 step-imbalance (test)
85.17Accuracy
7
CIFAR-10 Split 5 tasks (test)
32Accuracy
7
CIFAR-10-LT (ρ = 0.01) severe imbalance (test)
79.34AUROC (SVHN)
7
CIFAR-10-LT ρ = 0.1 mild imbalance (test)
90.5SVHN AUROC
7
CIFAR-10 IID
84.48Per-class Accuracy
7
CIFAR-10 (test)
1.77Top-1 Accuracy Change
7
Moving CIFAR-10
74.07SSIM
7
CIFAR-10 (test)
92.95Test Accuracy (alpha=0.1)
7
CIFAR-10 Dt (test)
84.31Micro F1-score
7