SUN397
Benchmarks
TaskDatasetSOTA resultTrendResults
SUN397
82.4Accuracy
116
SUN397 base-to-new generalization
79.63New Accuracy
48
SUN397
78.4Top-1 Accuracy
39
SUN397
36.39Robust Accuracy
31
SUN397 (novel classes)
0.77ECE
28
SUN397 (base classes)
81.68Accuracy
27
SUN397
54.26AutoAttack Robustness
19
SUN397 novel classes
80.18Accuracy
18
SUN397 MDCII Order-II
81.8Transfer Accuracy
15
SUN397 Base
83.7Top-1 Accuracy
14
SUN397 MDCII Order-I
71.1Transfer Accuracy
13
SUN397 Base-to-Novel
83.2Base Accuracy
12
SUN397 New classes
79.2Accuracy
12
SUN397 Base classes
83.23Accuracy
12
SUN397
83.23Base Accuracy
11
SUN397 Natural imbalance (test)
33.3bACC
11
SUN397
41.52Robust Accuracy
10
SUN397 (first split)
66.2Accuracy
10
SUN397 (test)
49.3Accuracy (K=5)
9
SUN397
82.69Base Score
8
SUN397 (test)
0.59AUROC
8
SUN397 16-shot
66.7Accuracy
7
SUN397 all-to-all
68.3Accuracy
7
SUN397 2010 (H)
80.35Top-1 Accuracy
6
SUN397 2010 (New classes)
78.7Top-1 Accuracy
6