Teachable Object Recognition on ORBIT CLE-VE 1.0 (test)
82.7Frame AccuracySimple CNAPs + LITE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Simple CNAPs + LITEBackbone=EfficientNet-B0, Image Size=224, LITE Training=true, MACs to adapt=3.39T, Steps to adapt=1F, Wall clock time=2.92s, Number of parameters=5.67M2021.07 | 82.7 | 4.1 | 91.8 | |
| ProtoNets + LITEBackbone=EfficientNet-B0, Image Size=224, LITE Training=true, MACs to adapt=1.21T, Steps to adapt=1F, Wall clock time=1.72s, Number of parameters=4.01M2021.07 | 82.1 | 3.9 | 91.2 | |
| Simple CNAPsBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=3.39T, Steps to adapt=1F, Wall clock time=2.91s, Number of parameters=5.67M2021.07 | 81.4 | 4.9 | 88.3 | |
| CNAPsBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=3.38T, Steps to adapt=1F, Wall clock time=2.83s, Number of parameters=10.59M2021.07 | 79.6 | 6.2 | 87 | |
| CNAPsBackbone=EfficientNet-B0, Image Size=224, LITE Training=true, MACs to adapt=3.38T, Steps to adapt=1F, Wall clock time=2.85s, Number of parameters=10.59M2021.07 | 79.6 | 5.9 | 87.6 | |
| MAMLBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=36.31T, Steps to adapt=15FB, Wall clock time=117.89s, Number of parameters=4.01M2021.07 | 79.3 | 6.2 | 87.5 | |
| ProtoNetsBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=1.21T, Steps to adapt=1F, Wall clock time=1.72s, Number of parameters=4.01M2021.07 | 78.4 | 4.7 | 87.9 | |
| FineTunerBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=121.02T, Steps to adapt=50FB, Wall clock time=139.99s, Number of parameters=4.01M2021.07 | 78.1 | 5.8 | 85.9 | |
| ProtoNetsBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=5.47T, Steps to adapt=1F, Wall clock time=1.07s, Number of parameters=11.18M2021.07 | 77.4 | 4.5 | 87.1 | |
| ProtoNets + LITEBackbone=ResNet-18, Image Size=224, LITE Training=true, MACs to adapt=5.47T, Steps to adapt=1F, Wall clock time=1.07s, Number of parameters=11.18M2021.07 | 76.7 | 5.1 | 86.4 | |
| Simple CNAPs + LITEBackbone=ResNet-18, Image Size=224, LITE Training=true, MACs to adapt=7.64T, Steps to adapt=1F, Wall clock time=2.14s, Number of parameters=11.97M2021.07 | 76.5 | 6.1 | 86.4 | |
| CNAPsBackbone=ResNet-18, Image Size=224, LITE Training=true, MACs to adapt=7.64T, Steps to adapt=1F, Wall clock time=2.11s, Number of parameters=12.76M2021.07 | 76 | 5.9 | 84.9 | |
| MAMLBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=163.97T, Steps to adapt=15FB, Wall clock time=65.22s, Number of parameters=11.18M2021.07 | 75.7 | 4.9 | 86.1 | |
| Simple CNAPsBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=7.64T, Steps to adapt=1F, Wall clock time=2.13s, Number of parameters=11.97M2021.07 | 75.2 | 6 | 84.6 | |
| CNAPsBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=7.64T, Steps to adapt=1F, Wall clock time=2.11s, Number of parameters=12.76M2021.07 | 73.6 | 5.4 | 83.4 | |
| FineTunerBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=546.57T, Steps to adapt=50FB, Wall clock time=96.23s, Number of parameters=11.18M2021.07 | 72.2 | 8.7 | 81.9 | |
| MAMLBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=95.31T, Steps to adapt=15FB, Wall clock time=36.98s, Number of parameters=11.17M2021.07 | 70.6 | 8.6 | 80.9 | |
| Simple CNAPsBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=3.48T, Steps to adapt=1F, Wall clock time=1.01s, Number of parameters=11.97M2021.07 | 70.3 | 7.3 | 83 | |
| FineTunerBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=317.70T, Steps to adapt=50FB, Wall clock time=53.94s, Number of parameters=11.17M2021.07 | 69.5 | 7.8 | 79.7 | |
| CNAPsBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=3.48T, Steps to adapt=1F, Wall clock time=0.98s, Number of parameters=12.75M2021.07 | 66.2 | 8.4 | 79.6 | |
| ProtoNetsBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=3.18T, Steps to adapt=1F, Wall clock time=0.73s, Number of parameters=11.17M2021.07 | 65.2 | 7.6 | 81.9 |