Permuted MNIST
Benchmarks
TaskDatasetSOTA resultTrendResults
Permuted MNIST (pMNIST) pixel-by-pixel (test)
96.7Accuracy (Clean)
25
Permuted MNIST 1000-tasks (last 5 tasks)
95.2Mean Accuracy (5 Tasks)
16
permuted-MNIST (test)
97.51Retained Accuracy
16
Permuted-MNIST (P-MNIST) (test)
97.73Accuracy
11
Permuted-MNIST Single-task
96.1Accuracy (1 Task)
8
Permuted MNIST 10 tasks
95.9Accuracy
5
Permuted-MNIST (5 tasks)
95.4Average Accuracy (AA)
4