# Accuracy Estimation on Office-Home (MAE)

Source: [Accuracy Estimation on Office-Home (MAE)](<https://www.sota2.com/research/sota/accuracy-estimation-on-office-home-mae>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:49:06.443Z

Evaluation of model accuracy estimation capabilities on the Office-Home dataset, measured using Mean Absolute Error (MAE).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Accuracy Estimation |
| Dataset (including any stated split) | Office-Home |
| Metric | MAE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 27 of 27 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MAE](<https://www.sota2.com/research/sota/accuracy-estimation-on-office-home-mae.md?metric=MAE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MAE | Result date | Report paper |
| --- | --- | --- | --- |
| COT | 0.602 | Not recorded | 68fa75d01e209131cea69ff5 |
| COT | 0.73 | Not recorded | 68fa75d01e209131cea69ff5 |
| ConfScore | 0.855 | Not recorded | 68fa75d01e209131cea69ff5 |
| MANO | 0.88 | Not recorded | 68fa75d01e209131cea69ff5 |
| Nuclear | 0.885 | Not recorded | 68fa75d01e209131cea69ff5 |
| Fréchet | 0.924 | Not recorded | 68fa75d01e209131cea69ff5 |
| Fréchet | 1.254 | Not recorded | 68fa75d01e209131cea69ff5 |
| Fréchet | 1.404 | Not recorded | 68fa75d01e209131cea69ff5 |
| Entropy | 1.874 | Not recorded | 68fa75d01e209131cea69ff5 |
| ConfScore | 1.987 | Not recorded | 68fa75d01e209131cea69ff5 |
| Nuclear | 2.176 | Not recorded | 68fa75d01e209131cea69ff5 |
| COT | 2.382 | Not recorded | 68fa75d01e209131cea69ff5 |
| ConfScore | 2.607 | Not recorded | 68fa75d01e209131cea69ff5 |
| Nuclear | 2.764 | Not recorded | 68fa75d01e209131cea69ff5 |
| Entropy | 2.878 | Not recorded | 68fa75d01e209131cea69ff5 |
| Entropy | 3.933 | Not recorded | 68fa75d01e209131cea69ff5 |
| MANO | 3.995 | Not recorded | 68fa75d01e209131cea69ff5 |
| MANO | 4.33 | Not recorded | 68fa75d01e209131cea69ff5 |
| Dispersion | 7.285 | Not recorded | 68fa75d01e209131cea69ff5 |
| ATC | 7.509 | Not recorded | 68fa75d01e209131cea69ff5 |
| Dispersion | 7.591 | Not recorded | 68fa75d01e209131cea69ff5 |
| MDE | 7.974 | Not recorded | 68fa75d01e209131cea69ff5 |
| Dispersion | 7.976 | Not recorded | 68fa75d01e209131cea69ff5 |
| MDE | 8.228 | Not recorded | 68fa75d01e209131cea69ff5 |
| MDE | 9.374 | Not recorded | 68fa75d01e209131cea69ff5 |
| ATC | 10.014 | Not recorded | 68fa75d01e209131cea69ff5 |
| ATC | 11.272 | Not recorded | 68fa75d01e209131cea69ff5 |

### COT

MAE: 0.602. Result ID: 6993e6c53a6c3148491953c3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e815.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### COT

MAE: 0.73. Result ID: 6993e6c53a6c3148491953cc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e815.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### ConfScore

MAE: 0.855. Result ID: 6993e6c53a6c3148491953c6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### MANO

MAE: 0.88. Result ID: 6993e6c53a6c3148491953c5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Nuclear

MAE: 0.885. Result ID: 6993e6c53a6c3148491953c4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e751e209131cea3ff83.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Fréchet

MAE: 0.924. Result ID: 6993e6c53a6c3148491953d2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a091e209131cea25a4a.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### Fréchet

MAE: 1.254. Result ID: 6993e6c53a6c3148491953c9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a091e209131cea25a4a.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### Fréchet

MAE: 1.404. Result ID: 6993e6c53a6c3148491953c0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a091e209131cea25a4a.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Entropy

MAE: 1.874. Result ID: 6993e6c53a6c3148491953c7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a9b1e209131cea29564.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### ConfScore

MAE: 1.987. Result ID: 6993e6c53a6c3148491953bd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Nuclear

MAE: 2.176. Result ID: 6993e6c53a6c3148491953cd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e751e209131cea3ff83.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### COT

MAE: 2.382. Result ID: 6993e6c53a6c3148491953d5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e815.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### ConfScore

MAE: 2.607. Result ID: 6993e6c53a6c3148491953cf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### Nuclear

MAE: 2.764. Result ID: 6993e6c53a6c3148491953d6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e751e209131cea3ff83.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### Entropy

MAE: 2.878. Result ID: 6993e6c53a6c3148491953be.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a9b1e209131cea29564.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### Entropy

MAE: 3.933. Result ID: 6993e6c53a6c3148491953d0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a9b1e209131cea29564.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### MANO

MAE: 3.995. Result ID: 6993e6c53a6c3148491953ce.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### MANO

MAE: 4.33. Result ID: 6993e6c53a6c3148491953d7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### Dispersion

MAE: 7.285. Result ID: 6993e6c53a6c3148491953ca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e42c.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### ATC

MAE: 7.509. Result ID: 6993e6c53a6c3148491953c8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dab1e209131cea3b57f.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### Dispersion

MAE: 7.591. Result ID: 6993e6c53a6c3148491953d3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e42c.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### MDE

MAE: 7.974. Result ID: 6993e6c53a6c3148491953d4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727f1e209131cea56c3d.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

### Dispersion

MAE: 7.976. Result ID: 6993e6c53a6c3148491953c1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e42c.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### MDE

MAE: 8.228. Result ID: 6993e6c53a6c3148491953c2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727f1e209131cea56c3d.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### MDE

MAE: 9.374. Result ID: 6993e6c53a6c3148491953cb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727f1e209131cea56c3d.md>)

Recorded evaluation configuration: {"Network":"ResNet50"}. This record does not assert independent reproduction.

### ATC

MAE: 10.014. Result ID: 6993e6c53a6c3148491953bf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dab1e209131cea3b57f.md>)

Recorded evaluation configuration: {"Network":"ResNet18"}. This record does not assert independent reproduction.

### ATC

MAE: 11.272. Result ID: 6993e6c53a6c3148491953d1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dab1e209131cea3b57f.md>)

Recorded evaluation configuration: {"Network":"WRN-50-2"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
