# Accuracy Estimation (MAE) on CIFAR-10

Source: [Accuracy Estimation (MAE) on CIFAR-10](<https://www.sota2.com/research/sota/accuracy-estimation-mae-on-cifar-10>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:49:06.376Z

Evaluation of model performance in estimating the accuracy of models trained on the CIFAR-10 dataset, specifically measured using Mean Absolute Error (MAE).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Accuracy Estimation |
| Dataset (including any stated split) | CIFAR-10 |
| Metric | MAE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 27 of 27 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MAE](<https://www.sota2.com/research/sota/accuracy-estimation-mae-on-cifar-10.md?metric=MAE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MAE | Result date | Report paper |
| --- | --- | --- | --- |
| COT | 0.355 | Not recorded | 68fa75d01e209131cea69ff5 |
| MANO | 0.394 | Not recorded | 68fa75d01e209131cea69ff5 |
| MANO | 0.406 | Not recorded | 68fa75d01e209131cea69ff5 |
| MANO | 0.45 | Not recorded | 68fa75d01e209131cea69ff5 |
| COT | 0.67 | Not recorded | 68fa75d01e209131cea69ff5 |
| Nuclear | 0.843 | Not recorded | 68fa75d01e209131cea69ff5 |
| MDE | 0.846 | Not recorded | 68fa75d01e209131cea69ff5 |
| MDE | 0.928 | Not recorded | 68fa75d01e209131cea69ff5 |
| COT | 0.952 | Not recorded | 68fa75d01e209131cea69ff5 |
| Nuclear | 1.024 | Not recorded | 68fa75d01e209131cea69ff5 |
| Nuclear | 1.357 | Not recorded | 68fa75d01e209131cea69ff5 |
| ATC | 1.706 | Not recorded | 68fa75d01e209131cea69ff5 |
| MDE | 1.763 | Not recorded | 68fa75d01e209131cea69ff5 |
| Entropy | 1.891 | Not recorded | 68fa75d01e209131cea69ff5 |
| ConfScore | 1.945 | Not recorded | 68fa75d01e209131cea69ff5 |
| Fréchet | 1.964 | Not recorded | 68fa75d01e209131cea69ff5 |
| Fréchet | 2.477 | Not recorded | 68fa75d01e209131cea69ff5 |
| Dispersion | 2.671 | Not recorded | 68fa75d01e209131cea69ff5 |
| ConfScore | 2.956 | Not recorded | 68fa75d01e209131cea69ff5 |
| ATC | 3.086 | Not recorded | 68fa75d01e209131cea69ff5 |
| Entropy | 3.16 | Not recorded | 68fa75d01e209131cea69ff5 |
| Fréchet | 3.547 | Not recorded | 68fa75d01e209131cea69ff5 |
| Dispersion | 3.842 | Not recorded | 68fa75d01e209131cea69ff5 |
| Dispersion | 3.842 | Not recorded | 68fa75d01e209131cea69ff5 |
| ATC | 3.968 | Not recorded | 68fa75d01e209131cea69ff5 |
| ConfScore | 5.131 | Not recorded | 68fa75d01e209131cea69ff5 |
| Entropy | 5.265 | Not recorded | 68fa75d01e209131cea69ff5 |

### COT

MAE: 0.355. Result ID: 6993e6c53a6c314849195369.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e815.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### MANO

MAE: 0.394. Result ID: 6993e6c53a6c314849195359.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### MANO

MAE: 0.406. Result ID: 6993e6c53a6c31484919536b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### MANO

MAE: 0.45. Result ID: 6993e6c53a6c314849195362.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### COT

MAE: 0.67. Result ID: 6993e6c53a6c314849195360.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e815.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### Nuclear

MAE: 0.843. Result ID: 6993e6c53a6c31484919536a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e751e209131cea3ff83.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### MDE

MAE: 0.846. Result ID: 6993e6c53a6c314849195368.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727f1e209131cea56c3d.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### MDE

MAE: 0.928. Result ID: 6993e6c53a6c31484919535f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727f1e209131cea56c3d.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### COT

MAE: 0.952. Result ID: 6993e6c53a6c314849195357.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e815.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Nuclear

MAE: 1.024. Result ID: 6993e6c53a6c314849195361.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e751e209131cea3ff83.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### Nuclear

MAE: 1.357. Result ID: 6993e6c53a6c314849195358.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e751e209131cea3ff83.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### ATC

MAE: 1.706. Result ID: 6993e6c53a6c31484919535c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dab1e209131cea3b57f.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### MDE

MAE: 1.763. Result ID: 6993e6c53a6c314849195356.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727f1e209131cea56c3d.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Entropy

MAE: 1.891. Result ID: 6993e6c53a6c31484919535b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a9b1e209131cea29564.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### ConfScore

MAE: 1.945. Result ID: 6993e6c53a6c31484919535a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### Fréchet

MAE: 1.964. Result ID: 6993e6c53a6c314849195354.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a091e209131cea25a4a.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Fréchet

MAE: 2.477. Result ID: 6993e6c53a6c31484919535d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a091e209131cea25a4a.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### Dispersion

MAE: 2.671. Result ID: 6993e6c53a6c314849195367.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e42c.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### ConfScore

MAE: 2.956. Result ID: 6993e6c53a6c314849195363.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### ATC

MAE: 3.086. Result ID: 6993e6c53a6c314849195365.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dab1e209131cea3b57f.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### Entropy

MAE: 3.16. Result ID: 6993e6c53a6c314849195364.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a9b1e209131cea29564.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### Fréchet

MAE: 3.547. Result ID: 6993e6c53a6c314849195366.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a091e209131cea25a4a.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### Dispersion

MAE: 3.842. Result ID: 6993e6c53a6c314849195355.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e42c.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Dispersion

MAE: 3.842. Result ID: 6993e6c53a6c31484919535e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e42c.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### ATC

MAE: 3.968. Result ID: 6993e6c53a6c314849195353.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dab1e209131cea3b57f.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### ConfScore

MAE: 5.131. Result ID: 6993e6c53a6c314849195351.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Entropy

MAE: 5.265. Result ID: 6993e6c53a6c314849195352.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a9b1e209131cea29564.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
