MTIL
Benchmarks
TaskDatasetSOTA resultTrendResults
MTIL Order II
89.2Average Acc
92
MTIL Order I 5-shot (test)
95.8Accuracy (Caltech101)
46
MTIL task-agnostic (test)
62Aircraft Accuracy
36
MTIL Aircraft, Caltech101, CIFAR100, DTD, EuroSAT, Flowers, Food, MNIST, OxfordPet, Cars, SUN397
96.8Caltech101 Accuracy
32
MTIL Order I (test)
79.1Average Accuracy
30
MTIL few-shot Order II (test)
88.8Accuracy (Food)
20
MTIL
85.9Average Accuracy
20
MTIL
242.4FoM
18
MTIL Transfer (test)
93Caltech101
17
MTIL Order I
70.4Transfer Acc
17
MTIL Last (test)
57.8Accuracy (Aircraft)
16
MTIL Aircraft, Caltech101, CIFAR100, DTD, EuroSAT, Flowers, Food, MNIST, OxfordPet, Cars, SUN397
59.6Aircraft Score
15
MTIL FS OrderI
69.9Transfer Value
9
MTIL Last 1.0 (test)
62Accuracy (Aircraft)
8
MTIL Average 1.0 (test)
62Accuracy (Aircraft)
8
MTIL benchmark Transfer 1.0 (test)
95.1Caltech101 Accuracy
8
MTIL benchmark
3Inference Time
4
MTIL-FS 16-shot (test)
69.6Transfer Accuracy
3