20-way 1-shot Classification on Omniglot (test)
99.2AccuracySiamese Nets
Evaluation Results
| Method | Links | |
|---|---|---|
| Siamese NetsSize=35.96M, MACs=1.36G2021.09 | 99.2 | |
| iMAMLInner optimizer=Hessian-Free2019.09 | 96.18 | |
| MAML2019.09 | 95.8 | |
| Oracle-ProtoNetscontrol=true2018.10 | 95.31 | |
| iMAMLInner optimizer=Gradient Descent (GD)2019.09 | 94.46 | |
| iMAMLorder=second-order, phase=two-phased2022.07 | 94.46 | |
| CMLorder=first-order, phase=two-phased2022.07 | 94.16 | |
| Matching NetsSize=225.91K, MACs=20.29M2021.09 | 93.8 | |
| LCPorder=first-order, phase=single-phase2022.07 | 91 | |
| T1-T2order=first-order, phase=single-phase2022.07 | 89.72 | |
| Reptile2019.09 | 89.43 | |
| Reptileorder=first-order, phase=single-phase2022.07 | 89.43 | |
| first-order MAML2019.09 | 89.4 | |
| FOMAMLorder=first-order, phase=single-phase2022.07 | 89.4 | |
| Oracle-MAMLcontrol=true2018.10 | 84.6 | |
| ACAI CACTUS-MAMLEmbedding=ACAI, k=500, P=1002018.10 | 48.09 | |
| ACAI CACTUS-ProtoNetsEmbedding=ACAI, k=500, P=1002018.10 | 47.75 | |
| ACAI linear classifierEmbedding=ACAI, Protocol=linear classifier2018.10 | 43.2 | |
| ACAI knn-nearest neighborsEmbedding=ACAI, Protocol=knn-nearest neighbors2018.10 | 39.73 | |
| BiGAN CACTUS-MAMLEmbedding=BiGAN, k=500, P=1002018.10 | 35.56 | |
| BiGAN CACTUS-ProtoNetsEmbedding=BiGAN, k=500, P=1002018.10 | 33.4 | |
| ACAI cluster matchingEmbedding=ACAI, Protocol=cluster matching, k=5002018.10 | 32.19 | |
| ACAI MLP with dropoutEmbedding=ACAI, Protocol=MLP with dropout2018.10 | 30.65 | |
| BiGAN linear classifierEmbedding=BiGAN, Protocol=linear classifier2018.10 | 27.8 | |
| BiGAN knn-nearest neighborsEmbedding=BiGAN, Protocol=knn-nearest neighbors2018.10 | 27.37 | |
| Training from scratch2018.10 | 24.91 | |
| BiGAN cluster matchingEmbedding=BiGAN, Protocol=cluster matching, k=5002018.10 | 21.54 | |
| BiGAN MLP with dropoutEmbedding=BiGAN, Protocol=MLP with dropout2018.10 | 19.92 |