ImageNet-C
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ImageNet-C mild scenario (severity level 5)
2.2Gauss Error
14
ImageNet-C severity level 5 1.0 (test)
54.4Average Error Rate
14
ImageNet-C OCTTA Average severity = 5 (test)
61.5Accuracy
13
ImageNet-C severity level 5 (test)
0.044ECE (Mean)
13
ImageNet-C Set 2
77.1Acc (Sev 1)
12
ImageNet-C Severity Level 3, Mixed Shifts v1 (test)
72.1Accuracy
12
ImageNet-C distribution shifted variants
64.6Average Accuracy
12
ImageNet-C level 5
66.1Accuracy
10
ImageNet-C 18 (test)
48.1Accuracy (ImageNet-C)
9
ImageNet-C level 1-5
36.8Error Rate (L1-5)
9
ImageNet-C (val)
40.78mCE
9
ImageNet-C (mixed domains)
44.6Error Rate (%)
8
ImageNet-C (20-revisit)
57.66Error Rate (%)
8
ImageNet-C Severity 1
75.24Top-1 Acc
8
ImageNet-C level 5 (test)
66.6Accuracy
7
ImageNet-C Label shift
64.2Accuracy
7
ImageNet-C (10 unseen domains)
58.5Accuracy (Motion)
6
ImageNet-C level 2
81.1Brightness
6
ImageNet-C level 1 1.0 (test)
81.6Brightness Accuracy
6
ImageNet-C 256x256 (val)
35.7Accuracy
5
ImageNet-C trained on ImageNet-LT Gaussian noise corruption level 5 (test)
12.91ECE
5
ImageNet-C extra corruptions (test)
49.6Average Accuracy
4
ImageNet-C Defocus blur severity-level-5 (val)
31.83Accuracy
4
ImageNet-C Severity 5 1.0
14.8Error Rate (Gaussian)
3
ImageNet-C 1.0 (Severity 1)
60.67Accuracy (Gaussian)
3