Vision Tasks
Benchmarks
TaskDatasetSOTA resultTrendResults
14 Vision Tasks
94.3Average Accuracy
160
8 Vision Tasks (SUN397, Stanford Cars, RESISC45, EuroSAT, SVHN, GTSRB, MNIST, DTD)
95.5Average Accuracy
90
8 Vision Tasks (test)
94.6Avg Accuracy
82
8 Vision tasks (test)
95.8Accuracy
77
8 vision tasks Average
95.81Average Accuracy
53
20 Vision Tasks
94.8Accuracy
48
14 vision tasks
94.3Accuracy
48
8 vision tasks
95.9Accuracy
48
14 vision tasks
94.3Average Absolute Accuracy
42
20 vision tasks
94.7Average Absolute Accuracy
40
8 Vision Tasks Low Confidence setting (test)
94Absolute Accuracy
32
8 Vision Tasks Norm Mismatch setting (test)
93.3Absolute Accuracy
32
8 vision tasks
92.4Accuracy
22
8 Vision Tasks (average)
86.3Average Accuracy
18
21 Vision Tasks (test)
81.13Accuracy
15
30 Vision Tasks
93.1Accuracy
12
Vision Tasks
0.841Kendall's Tau
6
14 vision tasks
79.5Accuracy
5
9 Vision Tasks ImageNet-1K added (test)
77SUN397 Accuracy
5
20 vision tasks
72.9Accuracy
4