Omniglot
Benchmarks
TaskDatasetSOTA resultTrendResults
Omniglot (test)
72.98Test Log Likelihood
15
Omniglot (train)
68.35Final Training Log Likelihood
15
Omniglot 20-way 5-shot
99.3Accuracy
15
Omniglot 20-way 1-shot
97.7Accuracy
15
Omniglot 5-Way
99.7Accuracy
15
Omniglot (train)
462.23Average ELBO
14
Omniglot (meta-test)
99.4Accuracy
12
Sequential Omniglot (S-OMNIGLOT) (test)
85.33Accuracy
12
Omniglot (novel classes)
99.53Accuracy
12
Omniglot 20-way (test)
99.49Accuracy
12
Omniglot (test)
99.84Top-1 Acc
11
Omniglot (test)
97.7Accuracy (5,1)
11
Omniglot cross-task from bg (eval)
0.802Accuracy (100)
11
OMNIGLOT
86.04NLL (nats)
10
Omniglot Meta-Dataset (test)
96Mean Accuracy
10
Omniglot dynamically binarized (test)
-107.26Log-Likelihood Bound (100-point)
9
Omniglot dynamically binarized (train)
-108.51Training ELBO
9
Omniglot standard (Random Split)
99.7Accuracy (5-way 1-shot)
9
Omniglot (meta-test)
3.8Error Rate
8
Omniglot (test)
-91.487Log Likelihood
8
Omniglot non-mutually-exclusive 77 (test)
95Accuracy
8
Omniglot 50 clients (test)
81.89Accuracy
8
Omniglot 5-way (test)
99.93Accuracy
8
Omniglot (sampled)
24Clustering Accuracy
8
OMNIGLOT binarized (test)
103.03NLL
7