# Image Classification on MNIST (test) (Cross-Entropy, MSE, Huber Loss, and R Metrics)

Source: [Image Classification on MNIST (test) (Cross-Entropy, MSE, Huber Loss, and R Metrics)](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-cross-entropy-mse-huber-loss-and-r-metrics>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:40:06.519Z

Evaluation of Image Classification performance on the MNIST test set, reporting various loss functions (Cross-entropy, MSE, Huber) alongside custom performance metrics (R\_pop, R\_opt, \|R\_gen\|).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Classification |
| Dataset (including any stated split) | MNIST (test) |
| Metric | Cross-Entropy Loss |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 3 of 3 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Cross-Entropy Loss](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-cross-entropy-mse-huber-loss-and-r-metrics.md?metric=Cross-Entropy%20Loss>): Lower is better; unit: SCALAR.

- [MSE Loss](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-cross-entropy-mse-huber-loss-and-r-metrics.md?metric=MSE%20Loss>): Lower is better; unit: SCALAR.

- [Huber Loss](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-cross-entropy-mse-huber-loss-and-r-metrics.md?metric=Huber%20Loss>): Lower is better; unit: SCALAR.

- [R\_pop](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-cross-entropy-mse-huber-loss-and-r-metrics.md?metric=R_pop>): Higher is better; unit: SCALAR.

- [R\_opt](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-cross-entropy-mse-huber-loss-and-r-metrics.md?metric=R_opt>): Higher is better; unit: SCALAR.

- [\|R\_gen\|](<https://www.sota2.com/research/sota/image-classification-on-mnist-test-cross-entropy-mse-huber-loss-and-r-metrics.md?metric=%7CR_gen%7C>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Cross-Entropy Loss | Result date | Report paper |
| --- | --- | --- | --- |
| Static | 306.9 | Not recorded | 68fa77a41e209131cea748dc |
| MoDo | 317.9 | Not recorded | 68fa77a41e209131cea748dc |
| MGDA | 363.6 | Not recorded | 68fa77a41e209131cea748dc |

### Static

Cross-Entropy Loss: 306.9. Result ID: 699559ce3badfaffe64afaab.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77a41e209131cea748dc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb21e209131cea41883.md>)

Recorded evaluation configuration: {"Weighting":"Static equal weighting"}. This record does not assert independent reproduction.

### MoDo

Cross-Entropy Loss: 317.9. Result ID: 699559ce3badfaffe64afaad.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77a41e209131cea748dc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77a41e209131cea748dc.md>)

[Implementation](<https://github.com/heshandevaka/Trade-Off-MOL>)

Recorded evaluation configuration: {"Weighting":"Momentum-based Multi-objective optimization"}. This record does not assert independent reproduction.

### MGDA

Cross-Entropy Loss: 363.6. Result ID: 699559ce3badfaffe64afaac.

[Reporting paper](<https://www.sota2.com/research/paper/68fa77a41e209131cea748dc.md>)

Recorded evaluation configuration: {"Weighting":"Multi-Gradient Descent Algorithm"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
