VTAB
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VTAB
4.3Memory Usage (GB)
9
VTAB
94.61Average Task Accuracy (AT)
9
VTAB natural
76.9Accuracy
9
VTAB
13.6ECE
8
VTAB
0.041Backward Transfer (BwT)
8
VTAB
89Caltech101 (All Acc)
8
VTAB
0.98Runtime (seconds)
7
VTAB Equ.T
71.7Accuracy (AT)
7
VTAB-Sim50
1.05Final Average Forgetting
6
VTAB Inc10 (test)
89.42Average Accuracy
6
VTAB
0.11Training Time (s)
6
vtab dmlab
19Accuracy
6
vtab pcam
69Accuracy
6
VTAB (test)
7.38Inference Time (ms)
5
VTAB 19 tasks (test)
77.63Accuracy
4
VTAB (test)
35.13Communication Cost (MB)
3
VTAB 19 tasks
94.6Accuracy
3
VTAB Sim50
95.89Accuracy
3
VTAB 5T small
92.34Accuracy
3
VTAB
95.5Accuracy
3
VTAB-1k CIFAR-100
59.37Accuracy
2
VTAB-2
86.76Avg Acc (A-bar)
2
VTAB-1
86.74Avg Accuracy (A-bar)
2
VTAB five 10-class datasets
90.46FAA
2
VTAB (test)
—Accuracy
0