# Unsupervised Accuracy Estimation on RR1-WILDS

Source: [Unsupervised Accuracy Estimation on RR1-WILDS](<https://www.sota2.com/research/sota/unsupervised-accuracy-estimation-on-rr1-wilds>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:59:15.649Z

Evaluation of model performance using Unsupervised Accuracy Estimation techniques on the RR1-WILDS dataset, reporting R-squared (R^2) and associated p-values.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Unsupervised Accuracy Estimation |
| Dataset (including any stated split) | RR1-WILDS |
| Metric | R-squared |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 36 of 36 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [R-squared](<https://www.sota2.com/research/sota/unsupervised-accuracy-estimation-on-rr1-wilds.md?metric=R-squared>): Higher is better; unit: SCALAR.

- [P-Value](<https://www.sota2.com/research/sota/unsupervised-accuracy-estimation-on-rr1-wilds.md?metric=P-Value>): Lower is better; unit: SCALAR.

## Recorded results

| Method | R-squared | Result date | Report paper |
| --- | --- | --- | --- |
| ATC | 0.988 | Not recorded | 68fa75d01e209131cea69ff5 |
| ATC | 0.986 | Not recorded | 68fa75d01e209131cea69ff5 |
| MANO | 0.983 | Not recorded | 68fa75d01e209131cea69ff5 |
| MANO | 0.978 | Not recorded | 68fa75d01e209131cea69ff5 |
| COT | 0.969 | Not recorded | 68fa75d01e209131cea69ff5 |
| MANO | 0.969 | Not recorded | 68fa75d01e209131cea69ff5 |
| COT | 0.96 | Not recorded | 68fa75d01e209131cea69ff5 |
| MDE | 0.954 | Not recorded | 68fa75d01e209131cea69ff5 |
| ConfScore | 0.951 | Not recorded | 68fa75d01e209131cea69ff5 |
| AgreeScore | 0.946 | Not recorded | 68fa75d01e209131cea69ff5 |
| ConfScore | 0.941 | Not recorded | 68fa75d01e209131cea69ff5 |
| AgreeScore | 0.938 | Not recorded | 68fa75d01e209131cea69ff5 |
| MDE | 0.938 | Not recorded | 68fa75d01e209131cea69ff5 |
| Fréchet | 0.936 | Not recorded | 68fa75d01e209131cea69ff5 |
| Fréchet | 0.935 | Not recorded | 68fa75d01e209131cea69ff5 |
| COT | 0.934 | Not recorded | 68fa75d01e209131cea69ff5 |
| AgreeScore | 0.929 | Not recorded | 68fa75d01e209131cea69ff5 |
| MDE | 0.927 | Not recorded | 68fa75d01e209131cea69ff5 |
| Fréchet | 0.922 | Not recorded | 68fa75d01e209131cea69ff5 |
| ConfScore | 0.918 | Not recorded | 68fa75d01e209131cea69ff5 |
| Nuclear | 0.906 | Not recorded | 68fa75d01e209131cea69ff5 |
| Nuclear | 0.885 | Not recorded | 68fa75d01e209131cea69ff5 |
| ProjNorm | 0.878 | Not recorded | 68fa75d01e209131cea69ff5 |
| ProjNorm | 0.867 | Not recorded | 68fa75d01e209131cea69ff5 |
| ProjNorm | 0.859 | Not recorded | 68fa75d01e209131cea69ff5 |
| Entropy | 0.846 | Not recorded | 68fa75d01e209131cea69ff5 |
| Dispersion | 0.843 | Not recorded | 68fa75d01e209131cea69ff5 |
| Nuclear | 0.84 | Not recorded | 68fa75d01e209131cea69ff5 |
| Entropy | 0.836 | Not recorded | 68fa75d01e209131cea69ff5 |
| Dispersion | 0.824 | Not recorded | 68fa75d01e209131cea69ff5 |
| Rotation | 0.821 | Not recorded | 68fa75d01e209131cea69ff5 |
| Entropy | 0.819 | Not recorded | 68fa75d01e209131cea69ff5 |
| Rotation | 0.74 | Not recorded | 68fa75d01e209131cea69ff5 |
| Dispersion | 0.737 | Not recorded | 68fa75d01e209131cea69ff5 |
| ATC | 0.342 | Not recorded | 68fa75d01e209131cea69ff5 |
| Rotation | 0.031 | Not recorded | 68fa75d01e209131cea69ff5 |

### ATC

R-squared: 0.988. Result ID: 6993e6c53a6c314849195349.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dab1e209131cea3b57f.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### ATC

R-squared: 0.986. Result ID: 6993e6c53a6c31484919533d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dab1e209131cea3b57f.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### MANO

R-squared: 0.983. Result ID: 6993e6c53a6c314849195338.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### MANO

R-squared: 0.978. Result ID: 6993e6c53a6c314849195344.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### COT

R-squared: 0.969. Result ID: 6993e6c53a6c314849195336.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e815.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### MANO

R-squared: 0.969. Result ID: 6993e6c53a6c314849195350.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### COT

R-squared: 0.96. Result ID: 6993e6c53a6c314849195342.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e815.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### MDE

R-squared: 0.954. Result ID: 6993e6c53a6c31484919534d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727f1e209131cea56c3d.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### ConfScore

R-squared: 0.951. Result ID: 6993e6c53a6c31484919532e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### AgreeScore

R-squared: 0.946. Result ID: 6993e6c53a6c314849195348.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c811e209131cea34627.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### ConfScore

R-squared: 0.941. Result ID: 6993e6c53a6c314849195346.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### AgreeScore

R-squared: 0.938. Result ID: 6993e6c53a6c31484919533c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c811e209131cea34627.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### MDE

R-squared: 0.938. Result ID: 6993e6c53a6c314849195341.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727f1e209131cea56c3d.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### Fréchet

R-squared: 0.936. Result ID: 6993e6c53a6c314849195332.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a091e209131cea25a4a.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### Fréchet

R-squared: 0.935. Result ID: 6993e6c53a6c31484919533e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a091e209131cea25a4a.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### COT

R-squared: 0.934. Result ID: 6993e6c53a6c31484919534e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e815.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### AgreeScore

R-squared: 0.929. Result ID: 6993e6c53a6c314849195330.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c811e209131cea34627.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### MDE

R-squared: 0.927. Result ID: 6993e6c53a6c314849195335.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa727f1e209131cea56c3d.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### Fréchet

R-squared: 0.922. Result ID: 6993e6c53a6c31484919534a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a091e209131cea25a4a.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### ConfScore

R-squared: 0.918. Result ID: 6993e6c53a6c31484919533a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### Nuclear

R-squared: 0.906. Result ID: 6993e6c53a6c314849195343.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e751e209131cea3ff83.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### Nuclear

R-squared: 0.885. Result ID: 6993e6c53a6c314849195337.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e751e209131cea3ff83.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### ProjNorm

R-squared: 0.878. Result ID: 6993e6c53a6c31484919534c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc01e209131cea30105.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### ProjNorm

R-squared: 0.867. Result ID: 6993e6c53a6c314849195340.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc01e209131cea30105.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### ProjNorm

R-squared: 0.859. Result ID: 6993e6c53a6c314849195334.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bc01e209131cea30105.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### Entropy

R-squared: 0.846. Result ID: 6993e6c53a6c314849195347.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a9b1e209131cea29564.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### Dispersion

R-squared: 0.843. Result ID: 6993e6c53a6c314849195333.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e42c.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### Nuclear

R-squared: 0.84. Result ID: 6993e6c53a6c31484919534f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e751e209131cea3ff83.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### Entropy

R-squared: 0.836. Result ID: 6993e6c53a6c31484919532f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a9b1e209131cea29564.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### Dispersion

R-squared: 0.824. Result ID: 6993e6c53a6c31484919534b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e42c.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

### Rotation

R-squared: 0.821. Result ID: 6993e6c53a6c31484919532d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1f1e209131cea261a1.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### Entropy

R-squared: 0.819. Result ID: 6993e6c53a6c31484919533b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a9b1e209131cea29564.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### Rotation

R-squared: 0.74. Result ID: 6993e6c53a6c314849195339.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1f1e209131cea261a1.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### Dispersion

R-squared: 0.737. Result ID: 6993e6c53a6c31484919533f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f21e209131cea4e42c.md>)

Recorded evaluation configuration: {"Model":"ResNet50"}. This record does not assert independent reproduction.

### ATC

R-squared: 0.342. Result ID: 6993e6c53a6c314849195331.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dab1e209131cea3b57f.md>)

Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction.

### Rotation

R-squared: 0.031. Result ID: 6993e6c53a6c314849195345.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75d01e209131cea69ff5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1f1e209131cea261a1.md>)

Recorded evaluation configuration: {"Model":"WRN-50-2"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
