VTAB
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VTAB 1k
79Overall Mean Accuracy
359
VTAB 1k (test)
89.09Accuracy (Natural)
145
VTAB
91.97Overall Accuracy
112
VTAB-1K 1.0 (test)
86Natural Accuracy
102
VTAB 1K
78.02Average Accuracy
95
VTAB
96.7Avg Accuracy
55
VTAB B0 Inc10
94.96Last Accuracy
54
VTAB v2 (test)
70.4Mean Accuracy
39
VTAB-1k v1 (test)
79.1Mean Accuracy
34
VTAB
62.66VTAB Mean Accuracy
31
VTAB-6
89.8Accuracy
29
VTAB+ 1.0 (test)
38.9Top-1 Accuracy
24
vtab pets
97.339Accuracy
22
VTAB
92.49Average Accuracy
21
VTAB
1.7Average Training Time per Task
21
VTAB 1k (test)
82.5Natural Accuracy
16
VTAB 1K (test)
78.8CIFAR-100 Accuracy
15
VTAB Free-Flow
69.38AT Score
14
VTAB CIL, T=5 (test)
92.2Avg Accuracy
11
VTAB-1K few-shot
93.34Caltech101 Accuracy
10
VTAB
93.19CIFAR-100 Accuracy
10
VTAB5T small Uniformly Abrupt scenario
94.24Average Accuracy
10
VTAB T=5 (test)
94.29Final Accuracy
10
VTAB-Sim50 Varying scenario
95.89Average Accuracy
9
VTAB5T-large Uniformly Abrupt scenario
89.37Average Accuracy
9