Omniglot
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Omniglot (meta-train)
0Classification Error
7
Omniglot Non-binarized original (test)
323.92Test Log-Likelihood Bound
7
Omniglot dynamically binarized (test)
-118.45Test Log-Likelihood Bound
7
Omniglot Meta-Dataset 1.0 (test)
0.866Accuracy
7
Omniglot (test)
85.7Acc (2-shot)
7
Omniglot 20%
0.992AUC
6
Omniglot 10%
0.991AUC
6
Omniglot 5%
99.1AUC
6
Omniglot Alphabets (meta-test)
93.7Average Score
6
Omniglot Meta-Training Alphabets (train)
99.6Average Performance
6
Omniglot (test)
0.065Error Rate
6
Omniglot (val)
5.69Error Rate
6
NME Omniglot (meta-test)
94.1Accuracy
6
Omniglot
98.352Accuracy
5
OmniGlot (unlabelled set)
89.1Accuracy
5
Omniglot Meta-Dataset seen
93.4Recall@1
5
Omniglot (test)
89.8Recall@1
5
Omniglot (test)
692nd Instance Accuracy
5
Omniglot
99Neg ELBO
5
Omniglot (target-average)
34.27Accuracy (%)
3
OMNIGLOT Out-of-Distribution (test)
99.3AUROC
3
Omniglot standard (Original Split)
96.68Accuracy (5-way 1-shot)
2
N-Omniglot
4,000Generation Speed (ms/sample)
1
Omniglot
—Primary metric
0