Teachable Object Recognition on ORBIT CLU-VE 1.0 (test)
66.3Frame AccuracyProtoNets + LITE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ProtoNets + LITEBackbone=EfficientNet-B0, Image Size=224, LITE Training=true, MACs to adapt=1.21T, Steps to adapt=1F, Wall clock time=1.72s, Number of parameters=4.01M2021.07 | 66.3 | 12.7 | 72.9 | |
| Simple CNAPsBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=3.39T, Steps to adapt=1F, Wall clock time=2.91s, Number of parameters=5.67M2021.07 | 65.6 | 11.2 | 69.9 | |
| Simple CNAPs + LITEBackbone=EfficientNet-B0, Image Size=224, LITE Training=true, MACs to adapt=3.39T, Steps to adapt=1F, Wall clock time=2.92s, Number of parameters=5.67M2021.07 | 65.6 | 13.5 | 71.9 | |
| MAMLBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=36.31T, Steps to adapt=15FB, Wall clock time=117.89s, Number of parameters=4.01M2021.07 | 64.6 | 12.8 | 69.4 | |
| CNAPsBackbone=EfficientNet-B0, Image Size=224, LITE Training=true, MACs to adapt=3.38T, Steps to adapt=1F, Wall clock time=2.85s, Number of parameters=10.59M2021.07 | 63.3 | 12.8 | 69.2 | |
| FineTunerBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=121.02T, Steps to adapt=50FB, Wall clock time=139.99s, Number of parameters=4.01M2021.07 | 63.1 | 11.5 | 66.9 | |
| CNAPsBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=3.38T, Steps to adapt=1F, Wall clock time=2.83s, Number of parameters=10.59M2021.07 | 62.6 | 13.2 | 67.4 | |
| ProtoNets + LITEBackbone=ResNet-18, Image Size=224, LITE Training=true, MACs to adapt=5.47T, Steps to adapt=1F, Wall clock time=1.07s, Number of parameters=11.18M2021.07 | 61.4 | 13.2 | 68.5 | |
| MAMLBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=163.97T, Steps to adapt=15FB, Wall clock time=65.22s, Number of parameters=11.18M2021.07 | 59.3 | 16.3 | 64.3 | |
| CNAPsBackbone=ResNet-18, Image Size=224, LITE Training=true, MACs to adapt=7.64T, Steps to adapt=1F, Wall clock time=2.11s, Number of parameters=12.76M2021.07 | 58.2 | 15.1 | 62.5 | |
| Simple CNAPsBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=7.64T, Steps to adapt=1F, Wall clock time=2.13s, Number of parameters=11.97M2021.07 | 58.1 | 14.7 | 60.9 | |
| CNAPsBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=7.64T, Steps to adapt=1F, Wall clock time=2.11s, Number of parameters=12.76M2021.07 | 57.6 | 14.9 | 66.5 | |
| Simple CNAPs + LITEBackbone=ResNet-18, Image Size=224, LITE Training=true, MACs to adapt=7.64T, Steps to adapt=1F, Wall clock time=2.14s, Number of parameters=11.97M2021.07 | 57.5 | 17.3 | 64.6 | |
| ProtoNetsBackbone=EfficientNet-B0, Image Size=224, LITE Training=false, MACs to adapt=1.21T, Steps to adapt=1F, Wall clock time=1.72s, Number of parameters=4.01M2021.07 | 57.3 | 12.7 | 63.9 | |
| ProtoNetsBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=5.47T, Steps to adapt=1F, Wall clock time=1.07s, Number of parameters=11.18M2021.07 | 56.8 | 14.4 | 62.5 | |
| FineTunerBackbone=ResNet-18, Image Size=224, LITE Training=false, MACs to adapt=546.57T, Steps to adapt=50FB, Wall clock time=96.23s, Number of parameters=11.18M2021.07 | 56.7 | 18.8 | 61.3 | |
| Simple CNAPsBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=3.48T, Steps to adapt=1F, Wall clock time=1.01s, Number of parameters=11.97M2021.07 | 53.9 | 16 | 62 | |
| FineTunerBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=317.70T, Steps to adapt=50FB, Wall clock time=53.94s, Number of parameters=11.17M2021.07 | 53.7 | 14.4 | 63.1 | |
| MAMLBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=95.31T, Steps to adapt=15FB, Wall clock time=36.98s, Number of parameters=11.17M2021.07 | 51.7 | 21 | 57.9 | |
| CNAPsBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=3.48T, Steps to adapt=1F, Wall clock time=0.98s, Number of parameters=12.75M2021.07 | 51.5 | 17.9 | 59.5 | |
| ProtoNetsBackbone=ResNet-18, Image Size=84, LITE Training=false, MACs to adapt=3.18T, Steps to adapt=1F, Wall clock time=0.73s, Number of parameters=11.17M2021.07 | 50.3 | 14.9 | 59.9 |