# Image Classification on MNIST (test) (Epsilon-based Robustness Evaluation)

Source: [Image Classification on MNIST (test) (Epsilon-based Robustness Evaluation)](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-epsilon-based-robustness-evaluation>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-06T08:31:14.862Z

Evaluation of Image Classification performance on the MNIST test set, reporting accuracy across various epsilon thresholds (3, 5.2, 9, 15.6, 27), likely measuring sensitivity to noise or perturbations.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Classification |
| Dataset (including any stated split) | MNIST (test) |
| Metric | Accuracy (epsilon=3) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy (epsilon=3)](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-epsilon-based-robustness-evaluation.md?metric=Accuracy%20(epsilon%3D3)>): Higher is better; unit: PERCENT.

- [Accuracy (epsilon=5.2)](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-epsilon-based-robustness-evaluation.md?metric=Accuracy%20(epsilon%3D5.2)>): Higher is better; unit: PERCENT.

- [Accuracy (epsilon=9)](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-epsilon-based-robustness-evaluation.md?metric=Accuracy%20(epsilon%3D9)>): Higher is better; unit: PERCENT.

- [Accuracy (epsilon=15.6)](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-epsilon-based-robustness-evaluation.md?metric=Accuracy%20(epsilon%3D15.6)>): Higher is better; unit: PERCENT.

- [Accuracy (epsilon=27)](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-epsilon-based-robustness-evaluation.md?metric=Accuracy%20(epsilon%3D27)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy (epsilon=3) | Result date | Report paper |
| --- | --- | --- | --- |
| Clip21-SGD2M | 62.6 | Not recorded | 68fa5cfd1e209131ce9d5e96 |
| Clip21-SGD2M | 61.2 | Not recorded | 68fa5cfd1e209131ce9d5e96 |
| Clip-SGD | 59.5 | Not recorded | 68fa5cfd1e209131ce9d5e96 |
| Clip-SGD | 58.9 | Not recorded | 68fa5cfd1e209131ce9d5e96 |
| Clip21-SGD | 49.2 | Not recorded | 68fa5cfd1e209131ce9d5e96 |
| Clip21-SGD | 46.1 | Not recorded | 68fa5cfd1e209131ce9d5e96 |
| α-NormEC | 10.4 | Not recorded | 68fa5cfd1e209131ce9d5e96 |
| α-NormEC | 9 | Not recorded | 68fa5cfd1e209131ce9d5e96 |

### Clip21-SGD2M

Accuracy (epsilon=3): 62.6. Result ID: 69aa90cb6dbb7075b954545b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

Recorded evaluation configuration: {"Model":"MLP","Hyperparameters":"batch size 64, # epochs 150, n = 25","delta":"10^-3"}. This record does not assert independent reproduction.

### Clip21-SGD2M

Accuracy (epsilon=3): 61.2. Result ID: 69aa90cb6dbb7075b954545f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

Recorded evaluation configuration: {"Model":"CNN","Hyperparameters":"batch size 64, # epochs 150, n = 25","delta":"10^-3"}. This record does not assert independent reproduction.

### Clip-SGD

Accuracy (epsilon=3): 59.5. Result ID: 69aa90cb6dbb7075b9545458.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65301e209131cea08bf5.md>)

Recorded evaluation configuration: {"Model":"MLP","Hyperparameters":"batch size 64, # epochs 150, n = 25","delta":"10^-3"}. This record does not assert independent reproduction.

### Clip-SGD

Accuracy (epsilon=3): 58.9. Result ID: 69aa90cb6dbb7075b954545c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65301e209131cea08bf5.md>)

Recorded evaluation configuration: {"Model":"CNN","Hyperparameters":"batch size 64, # epochs 150, n = 25","delta":"10^-3"}. This record does not assert independent reproduction.

### Clip21-SGD

Accuracy (epsilon=3): 49.2. Result ID: 69aa90cb6dbb7075b9545459.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5a711e209131ce9bfed8.md>)

Recorded evaluation configuration: {"Model":"MLP","Hyperparameters":"batch size 64, # epochs 150, n = 25","delta":"10^-3"}. This record does not assert independent reproduction.

### Clip21-SGD

Accuracy (epsilon=3): 46.1. Result ID: 69aa90cb6dbb7075b954545d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5a711e209131ce9bfed8.md>)

Recorded evaluation configuration: {"Model":"CNN","Hyperparameters":"batch size 64, # epochs 150, n = 25","delta":"10^-3"}. This record does not assert independent reproduction.

### α-NormEC

Accuracy (epsilon=3): 10.4. Result ID: 69aa90cb6dbb7075b954545e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5cff1e209131ce9d608e.md>)

Recorded evaluation configuration: {"Model":"CNN","Hyperparameters":"batch size 64, # epochs 150, n = 25","delta":"10^-3"}. This record does not assert independent reproduction.

### α-NormEC

Accuracy (epsilon=3): 9. Result ID: 69aa90cb6dbb7075b954545a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5cfd1e209131ce9d5e96.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5cff1e209131ce9d608e.md>)

Recorded evaluation configuration: {"Model":"MLP","Hyperparameters":"batch size 64, # epochs 150, n = 25","delta":"10^-3"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
