# Permuted Image Classification on pMNIST 784

Source: [Permuted Image Classification on pMNIST 784](<https://www.sota2.com/research/sota/permuted-image-classification-on-pmnist-784>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:29:04.452Z

Evaluation of Permuted Image Classification performance on the pMNIST 784 dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Permuted Image Classification |
| Dataset (including any stated split) | pMNIST 784 |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/permuted-image-classification-on-pmnist-784.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Transformer | 97.1 | Not recorded | 68fa70411e209131cea49f65 |
| SRNN | 96.43 | Not recorded | 68fa70411e209131cea49f65 |
| MemUP | 95.4 | Not recorded | 68fa70411e209131cea49f65 |
| SRNN | 95.33 | Not recorded | 68fa70411e209131cea49f65 |
| LSTM | 89.5 | Not recorded | 68fa70411e209131cea49f65 |
| Transformer | 84.55 | Not recorded | 68fa70411e209131cea49f65 |
| LSTM | 79.85 | Not recorded | 68fa70411e209131cea49f65 |

### Transformer

Accuracy: 97.1. Result ID: 699125ad3a6c314849060781.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70411e209131cea49f65.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Truncated Training":false}. This record does not assert independent reproduction.

### SRNN

Accuracy: 96.43. Result ID: 699125ad3a6c31484906077f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70411e209131cea49f65.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f41e209131cea1962a.md>)

Recorded evaluation configuration: {"Truncated Training":false}. This record does not assert independent reproduction.

### MemUP

Accuracy: 95.4. Result ID: 699125ad3a6c31484906077c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70411e209131cea49f65.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70411e209131cea49f65.md>)

[Implementation](<https://github.com/griver/memup>)

Recorded evaluation configuration: {"Truncated Training":true}. This record does not assert independent reproduction.

### SRNN

Accuracy: 95.33. Result ID: 699125ad3a6c314849060780.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70411e209131cea49f65.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f41e209131cea1962a.md>)

Recorded evaluation configuration: {"Truncated Training":true}. This record does not assert independent reproduction.

### LSTM

Accuracy: 89.5. Result ID: 699125ad3a6c31484906077d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70411e209131cea49f65.md>)

Recorded evaluation configuration: {"Truncated Training":false}. This record does not assert independent reproduction.

### Transformer

Accuracy: 84.55. Result ID: 699125ad3a6c314849060782.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70411e209131cea49f65.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Truncated Training":true}. This record does not assert independent reproduction.

### LSTM

Accuracy: 79.85. Result ID: 699125ad3a6c31484906077e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70411e209131cea49f65.md>)

Recorded evaluation configuration: {"Truncated Training":true}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.