# Image Classification on PMNIST Domain-Incremental (test)

Source: [Image Classification on PMNIST Domain-Incremental (test)](<https://www.sota2.com/research/sota/image-classification-on-pmnist-domain-incremental-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-09T08:43:37.441Z

Evaluation of Image Classification performance on the test split of the PMNIST Domain-Incremental dataset, reporting Accuracy and Forgetting metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Classification |
| Dataset (including any stated split) | PMNIST Domain-Incremental (test) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/image-classification-on-pmnist-domain-incremental-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Forgetting](<https://www.sota2.com/research/sota/image-classification-on-pmnist-domain-incremental-test.md?metric=Forgetting>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| COLD | 91.26 | Not recorded | 6a279e1c90966ade919bf719 |
| COLD-ORACLE | 91.19 | Not recorded | 6a279e1c90966ade919bf719 |
| DER++ | 78.74 | Not recorded | 6a279e1c90966ade919bf719 |
| DER | 78.72 | Not recorded | 6a279e1c90966ade919bf719 |
| EWC | 69.49 | Not recorded | 6a279e1c90966ade919bf719 |
| A-GEM | 62.12 | Not recorded | 6a279e1c90966ade919bf719 |
| NCCL | 61.93 | Not recorded | 6a279e1c90966ade919bf719 |
| Fine-tune | 36.79 | Not recorded | 6a279e1c90966ade919bf719 |

### COLD

Accuracy: 91.26. Result ID: 6a27d21cfbc373592c249f91.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

Recorded evaluation configuration: {"M":"5k"}. This record does not assert independent reproduction.

### COLD-ORACLE

Accuracy: 91.19. Result ID: 6a27d21cfbc373592c249f92.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

Recorded evaluation configuration: {"M":"5k"}. This record does not assert independent reproduction.

### DER++

Accuracy: 78.74. Result ID: 6a27d21cfbc373592c249f8f.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68a11e209131cea1d3e2.md>)

[Implementation](<https://github.com/aimagelab/mammoth>)

Recorded evaluation configuration: {"M":"5k","Year":"2020"}. This record does not assert independent reproduction.

### DER

Accuracy: 78.72. Result ID: 6a27d21cfbc373592c249f8e.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68a11e209131cea1d3e2.md>)

[Implementation](<https://github.com/aimagelab/mammoth>)

Recorded evaluation configuration: {"M":"5k","Year":"2020"}. This record does not assert independent reproduction.

### EWC

Accuracy: 69.49. Result ID: 6a27d21cfbc373592c249f8c.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cb31e209131cea3555e.md>)

Recorded evaluation configuration: {"M":"5k","Year":"2017"}. This record does not assert independent reproduction.

### A-GEM

Accuracy: 62.12. Result ID: 6a27d21cfbc373592c249f8d.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65371e209131cea090ac.md>)

[Implementation](<https://github.com/facebookresearch/agem>)

Recorded evaluation configuration: {"M":"5k","Year":"2019"}. This record does not assert independent reproduction.

### NCCL

Accuracy: 61.93. Result ID: 6a27d21cfbc373592c249f90.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ec1e209131cea5942f.md>)

Recorded evaluation configuration: {"M":"5k","Year":"2023"}. This record does not assert independent reproduction.

### Fine-tune

Accuracy: 36.79. Result ID: 6a27d21cfbc373592c249f8b.

[Reporting paper](<https://www.sota2.com/research/paper/6a279e1c90966ade919bf719.md>)

Recorded evaluation configuration: {"M":"5k"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.