SUN
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SUN
33.2Metric A
18
SUN pure ZSL setting (target classes)
63.6Top-1 Accuracy (per-class)
17
SUN Instructive Visual Benchmark
44.68Accuracy
16
SUN Gemini Annotations Oracle (test)
52.94Top-1 Retrieval Accuracy
16
SUN (test)
98.17AUROC (Original)
16
SUN (unseen)
76.86Accuracy
16
SUN397 (Novel)
79.5Top-1 Acc
15
SUN
55.1U Metric
15
SUN (Proposed Split)
63.3Top-1 Acc (Class-Avg)
15
SUN397
71.53CA
14
SUN397
83.2Base Accuracy
14
SUN (test)
38Seen Class Accuracy (a->s)
14
SUN397
64.8Clean Accuracy
13
SUN397
77.3Base Accuracy
13
SUN-C severity = 5 (test)
61.5Accuracy
13
SUN-C severity 5
61.9Accuracy (ACC)
13
SUN397
67.7Accuracy
12
SUN397
67.7Zero-Shot Accuracy
12
SUN397
0.08CovGap
12
SUN novel
78.72LA Score
12
SUN
66Top-1 Acc
12
SUN
72.6Multi-way Accuracy
12
SUN ZSL
77.3Top-1 Acc
11
SUN long-tailed (test)
36.1AccPC
11
SUN-397 8 fine-grained tasks
95Average Accuracy
10