SUN
Benchmarks
TaskDatasetSOTA resultTrendResults
SUN397 H (harmonic mean)
78.27Accuracy
4
SUN
0.807Weighted Kendall's tau
4
SUN PS
65.5Top-1 Accuracy
4
Sun397 20% (test)
99Accuracy
3
SUN
98.2AUROC
3
SUN397
4True Positives (TP)
3
SUN397 8-shot
79.2Accuracy
3
SUN397 (test)
56.71-shot Accuracy
3
SUN397 (test)
61.58Accuracy (All Noise)
3
SUN (test)
821-shot Accuracy
3
SUN397
3.2AECE
2
SUN397 (test)
8.95Avg User Corrections
2
SUN397
77.87Accuracy
2
SUN397
62.6Zero-Shot Accuracy
1
SUN397
67.7Zero-Shot Accuracy
1
SUN397 (test)
50.4Adversarial Accuracy
1
SUN397
35.99Donor Best Top-1 Accuracy Change
1
SUN397 T=50
83.55Last-Task Accuracy (AT)
1
SUN RGBD
2.9mAP@0.25
1
SUN397
—Robust Acc
0
SUN397 forest field jungle etc (novel categories)
—Primary metric
0
SUN397 novel categories
—Primary metric
0
SUN v1 (test)
—Top-1 Acc (ZSL)
0
SUN-LT
—Accuracy
0