5-way 1-shot Classification on Omniglot (test)
99.5AccuracyiMAML
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| iMAMLInner optimizer=Hessian-Free2019.09 | 99.5 | — | — | |
| iMAMLInner optimizer=Gradient Descent (GD)2019.09 | 99.16 | — | — | |
| MAML2019.09 | 98.7 | — | — | |
| Oracle-ProtoNetscontrol=true2018.10 | 98.35 | — | — | |
| ProtoNetsClustering=N/A, Supervised=true2020.04 | 98.35 | — | — | |
| first-order MAML2019.09 | 98.3 | — | — | |
| Reptile2019.09 | 97.68 | — | — | |
| Oracle-MAMLcontrol=true2018.10 | 94.46 | — | — | |
| MAMLClustering=N/A, Supervised=true2020.04 | 94.46 | — | — | |
| ULDA-ProtoNetsClustering=N/A2020.04 | 91 | — | — | |
| ULDA-MetaOptNetClustering=N/A2020.04 | 90.51 | — | — | |
| AAL-MAML++Clustering=N/A2020.04 | 88.4 | — | — | |
| AAL-ProtoNetsClustering=N/A2020.04 | 84.66 | — | — | |
| UMTRAClustering=N/A2020.04 | 83.8 | — | — | |
| ACAI CACTUS-MAMLEmbedding=ACAI, k=500, P=1002018.10 | 68.84 | — | — | |
| CACTUS-MAMLClustering=ACAI2020.04 | 68.84 | — | — | |
| ACAI CACTUS-ProtoNetsEmbedding=ACAI, k=500, P=1002018.10 | 68.12 | — | — | |
| CACTUS-ProtoNetsClustering=ACAI2020.04 | 68.12 | — | — | |
| ACAI linear classifierEmbedding=ACAI, Protocol=linear classifier2018.10 | 61.08 | — | — | |
| BiGAN CACTUS-MAMLEmbedding=BiGAN, k=500, P=1002018.10 | 58.18 | — | — | |
| ACAI knn-nearest neighborsEmbedding=ACAI, Protocol=knn-nearest neighbors2018.10 | 57.46 | — | — | |
| ACAI cluster matchingEmbedding=ACAI, Protocol=cluster matching, k=5002018.10 | 54.94 | — | — | |
| BiGAN CACTUS-ProtoNetsEmbedding=BiGAN, k=500, P=1002018.10 | 54.74 | — | — | |
| Training from scratch2018.10 | 52.5 | — | — | |
| Training from scratchClustering=N/A2020.04 | 52.5 | — | — | |
| ACAI MLP with dropoutEmbedding=ACAI, Protocol=MLP with dropout2018.10 | 51.95 | — | — | |
| BiGAN knn-nearest neighborsEmbedding=BiGAN, Protocol=knn-nearest neighbors2018.10 | 49.55 | — | — | |
| knn-nearest neighborsClustering=DeepCluster2020.04 | 49.55 | — | — | |
| BiGAN linear classifierEmbedding=BiGAN, Protocol=linear classifier2018.10 | 48.28 | — | — | |
| linear classifierClustering=DeepCluster2020.04 | 48.28 | — | — | |
| BiGAN cluster matchingEmbedding=BiGAN, Protocol=cluster matching, k=5002018.10 | 43.96 | — | — | |
| cluster matchingClustering=DeepCluster2020.04 | 43.96 | — | — | |
| BiGAN MLP with dropoutEmbedding=BiGAN, Protocol=MLP with dropout2018.10 | 40.54 | — | — | |
| MLP with dropoutClustering=DeepCluster2020.04 | 40.54 | — | — | |
| BASELINE CLASSIFIERMatching Function=Cosine, Fine-tuned=N2016.06 | — | 80 | 95 | |
| BASELINE CLASSIFIERMatching Function=Cosine, Fine-tuned=Y2016.06 | — | 82.3 | 98.4 | |
| BASELINE CLASSIFIERMatching Function=Softmax, Fine-tuned=Y2016.06 | — | 86 | 97.6 | |
| BASELINE CLASSIFIERMatching Function=Cosine, Fine-tuned=N2016.06 | — | 69.5 | 89.1 | |
| BASELINE CLASSIFIERMatching Function=Cosine, Fine-tuned=Y2016.06 | — | 70.6 | 92 | |
| BASELINE CLASSIFIERMatching Function=Softmax, Fine-tuned=Y2016.06 | — | 72.9 | 92.3 | |
| CONVOLUTIONAL SIAMESE NETMatching Function=Cosine, Fine-tuned=N2016.06 | — | 96.7 | 98.4 | |
| CONVOLUTIONAL SIAMESE NETMatching Function=Cosine, Fine-tuned=Y2016.06 | — | 97.3 | 98.4 | |
| CONVOLUTIONAL SIAMESE NETMatching Function=Cosine, Fine-tuned=N2016.06 | — | 88 | 96.5 | |
| CONVOLUTIONAL SIAMESE NETMatching Function=Cosine, Fine-tuned=Y2016.06 | — | 88.1 | 97 | |
| GNN2019.02 | — | 99.2 | — | |
| MAML2019.02 | — | 98.7 | — | |
| MAML++2019.02 | — | 99.47 | — | |
| MANN (NO CONV)Matching Function=Cosine, Fine-tuned=N2016.06 | — | 82.8 | 94.9 | |
| Matching NetworksMatching Function=Cosine, Fine-tuned=N2016.06 | — | 98.1 | 98.9 | |
| Matching NetworksMatching Function=Cosine, Fine-tuned=Y2016.06 | — | 97.9 | 98.7 | |
| Matching NetworksMatching Function=Cosine, Fine-tuned=N2016.06 | — | 93.8 | 98.5 | |
| Matching NetworksMatching Function=Cosine, Fine-tuned=Y2016.06 | — | 93.5 | 98.7 | |
| MC12019.02 | — | 99.47 | — | |
| MC22019.02 | — | 99.77 | — | |
| MC2Ensemble=3 model2019.02 | — | 99.97 | — | |
| Meta-SGD2019.02 | — | 99.53 | — | |
| PIXELSMatching Function=Cosine, Fine-tuned=N2016.06 | — | 41.7 | 63.2 | |
| PIXELSMatching Function=Cosine, Fine-tuned=N2016.06 | — | 26.7 | 42.6 | |
| SNAIL2019.02 | — | 99.07 | — |