Image Classification on fMoW (test)
98.96Top-1 AccuracyConfidence
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ConfidenceAL Setup (Initial + Rounds x Batch Size)=100 + 10 x 202025.10 | 98.96 | — | — | — | — | — | |
| ParBaLS EPIGAL Setup (Initial + Rounds x Batch Size)=100 + 10 x 202025.10 | 98.41 | — | — | — | — | — | |
| ParBaLS-MAP EPIGAL Setup (Initial + Rounds x Batch Size)=100 + 10 x 202025.10 | 97.87 | — | — | — | — | — | |
| ParBaLS EPIGAL Setup=20 + 10 x 202025.10 | 95.45 | — | — | — | — | — | |
| ParBaLS EPIGAL Budget=20 + 10 x 20, Seeds=102025.10 | 95.45 | — | — | — | — | — | |
| ConfidenceAL Setup=20 + 10 x 202025.10 | 94.69 | — | — | — | — | — | |
| GALAXYAL Setup (Initial + Rounds x Batch Size)=100 + 10 x 202025.10 | 94.5 | — | — | — | — | — | |
| ParBaLS EPIGinitial_labels=100, query_schedule=10 x 102025.10 | 93.56 | — | — | — | — | — | |
| ParBaLS EPIGAL setup=100 + 10 x 102025.10 | 93.56 | — | — | — | — | — | |
| ParBaLS-MAP EPIGAL Setup=20 + 10 x 202025.10 | 93.51 | — | — | — | — | — | |
| ParBaLS-MAP EPIGAL Budget=20 + 10 x 20, Seeds=102025.10 | 93.51 | — | — | — | — | — | |
| BADGEAL Setup (Initial + Rounds x Batch Size)=100 + 10 x 202025.10 | 92.54 | — | — | — | — | — | |
| EPIGAL Budget=20 + 10 x 20, Seeds=102025.10 | 92.03 | — | — | — | — | — | |
| Confidenceinitial_labels=100, query_schedule=10 x 102025.10 | 91.78 | — | — | — | — | — | |
| GLISTERAL Setup (Initial + Rounds x Batch Size)=100 + 10 x 202025.10 | 91.69 | — | — | — | — | — | |
| ParBaLS-MAP EPIGinitial_labels=100, query_schedule=10 x 102025.10 | 91.25 | — | — | — | — | — | |
| ParBaLS-MAP EPIGAL setup=100 + 10 x 102025.10 | 91.25 | — | — | — | — | — | |
| SoftRankEPIGAL Budget=20 + 10 x 20, Seeds=102025.10 | 91.2 | — | — | — | — | — | |
| EPIGAL setup=100 + 10 x 102025.10 | 90.37 | — | — | — | — | — | |
| RandomAL Setup (Initial + Rounds x Batch Size)=100 + 10 x 202025.10 | 90.02 | — | — | — | — | — | |
| SoftRankEPIGAL setup=100 + 10 x 102025.10 | 89.66 | — | — | — | — | — | |
| GALAXYAL Setup=20 + 10 x 202025.10 | 89.28 | — | — | — | — | — | |
| GALAXYinitial_labels=100, query_schedule=10 x 102025.10 | 88.44 | — | — | — | — | — | |
| SoftmaxEPIGAL Budget=20 + 10 x 20, Seeds=102025.10 | 87.27 | — | — | — | — | — | |
| SoftmaxBALDAL Budget=20 + 10 x 20, Seeds=102025.10 | 87.06 | — | — | — | — | — | |
| PowerBALDAL Budget=20 + 10 x 20, Seeds=102025.10 | 86.6 | — | — | — | — | — | |
| BADGEAL Setup=20 + 10 x 202025.10 | 85.81 | — | — | — | — | — | |
| RandomAL Setup=20 + 10 x 202025.10 | 85.47 | — | — | — | — | — | |
| SoftmaxEPIGAL setup=100 + 10 x 102025.10 | 85.35 | — | — | — | — | — | |
| Randominitial_labels=100, query_schedule=10 x 102025.10 | 84.7 | — | — | — | — | — | |
| PowerEPIGAL Budget=20 + 10 x 20, Seeds=102025.10 | 84.6 | — | — | — | — | — | |
| BatchBALDAL setup=100 + 10 x 102025.10 | 84.52 | — | — | — | — | — | |
| PowerEPIGAL setup=100 + 10 x 102025.10 | 84.32 | — | — | — | — | — | |
| PowerBALDAL setup=100 + 10 x 102025.10 | 84.31 | — | — | — | — | — | |
| SoftmaxBALDAL setup=100 + 10 x 102025.10 | 84.18 | — | — | — | — | — | |
| SoftRankBALDAL Budget=20 + 10 x 20, Seeds=102025.10 | 82.98 | — | — | — | — | — | |
| BADGEinitial_labels=100, query_schedule=10 x 102025.10 | 82.56 | — | — | — | — | — | |
| SoftRankBALDAL setup=100 + 10 x 102025.10 | 82.52 | — | — | — | — | — | |
| BALDAL setup=100 + 10 x 102025.10 | 81.79 | — | — | — | — | — | |
| GLISTERinitial_labels=100, query_schedule=10 x 102025.10 | 81.78 | — | — | — | — | — | |
| GLISTERAL Setup=20 + 10 x 202025.10 | 75.89 | — | — | — | — | — | |
| BALDAL Budget=20 + 10 x 20, Seeds=102025.10 | 75.47 | — | — | — | — | — | |
| Zoom-In Network (Res)Backbone=ResNet16, FLOPs (B)=2.24, Memory (Mb)=13.53, Time (ms)=12.252021.06 | 74.3 | — | — | — | — | — | |
| CoreSetAL Setup (Initial + Rounds x Batch Size)=100 + 10 x 202025.10 | 73.35 | — | — | — | — | — | |
| Zoom-In NetworkBackbone=LeNet, FLOPs (B)=1.85, Memory (Mb)=10.81, Time (ms)=11.472021.06 | 72.9 | — | — | — | — | — | |
| CoreSetinitial_labels=100, query_schedule=10 x 102025.10 | 72.79 | — | — | — | — | — | |
| TNetInput Size=896x896, #Locs=42021.02 | 72.16 | 91.98 | 1.94 | 4.56 | — | 3.13 | |
| TNetInput Size=896x896, #Locs=62021.02 | 71.92 | 91.83 | 2.71 | 4.56 | — | 3.47 | |
| TNetInput Size=448x448, #Locs=32021.02 | 71.57 | 91.72 | 1.55 | 4.56 | — | 2.03 | |
| TNetInput Size=448x448, #Locs=22021.02 | 71.46 | 91.58 | 1.16 | 4.56 | — | 1.55 | |
| DenseNet-121Input Size=224x2242021.02 | 70.7 | — | 3 | 7.1 | — | — | |
| EfficientNet-B0Input Size=896x8962021.02 | 70.6 | 90.81 | 6.18 | 4.13 | — | 10.35 | |
| EfficientNet-B0FLOPs (B)=8.22, Memory (Mb)=1404.09, Time (ms)=22.722021.06 | 70.2 | — | — | — | — | — | |
| TNetInput Size=448x448, #Locs=12021.02 | 70.17 | 90.99 | 0.77 | 4.56 | — | 1.3 | |
| EfficientNet-B0Input Size=448x4482021.02 | 69.83 | 90.22 | 1.54 | 4.13 | — | 2.6 | |
| EfficientNet-B0Input Size=224x224, BBoxes=true2021.02 | 69.7 | 89.22 | 0.39 | 4.13 | — | 0.76 | |
| ResNet-50Input Size=224x2242021.02 | 67.3 | — | 4.09 | 23.71 | — | — | |
| EfficientNet-B0Input Size=224x2242021.02 | 62.8 | 84.97 | 0.39 | 4.13 | — | 0.76 | |
| CoreSetAL Setup=20 + 10 x 202025.10 | 57.75 | — | — | — | — | — | |
| TNetInput Size=224x224, #Locs=02021.02 | 47.79 | 81.14 | 0.39 | — | — | 0.76 |