# Selective Classification on ImageNet-A

Source: [Selective Classification on ImageNet-A](<https://www.sota2.com/research/sota/selective-classification-on-imagenet-a>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:25:44.641Z

Evaluation of Selective Classification performance on the ImageNet-A dataset, measured using AURC and NAURC metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Selective classification |
| Dataset (including any stated split) | ImageNet-A |
| Metric | AURC |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AURC](<https://www.sota2.com/research/sota/selective-classification-on-imagenet-a.md?metric=AURC>): Higher is better; unit: SCALAR.

- [NAURC](<https://www.sota2.com/research/sota/selective-classification-on-imagenet-a.md?metric=NAURC>): Higher is better; unit: SCALAR.

## Recorded results

| Method | AURC | Result date | Report paper |
| --- | --- | --- | --- |
| Energy | 0.122 | Not recorded | 68fa78a61e209131cea79954 |
| SIRC | 0.0848 | Not recorded | 68fa78a61e209131cea79954 |
| MDS | 0.0321 | Not recorded | 68fa78a61e209131cea79954 |
| MaxLogit | 0.0296 | Not recorded | 68fa78a61e209131cea79954 |
| KNN | 0.0267 | Not recorded | 68fa78a61e209131cea79954 |
| Δ-MDS | 0.0243 | Not recorded | 68fa78a61e209131cea79954 |
| MSP | 0.0229 | Not recorded | 68fa78a61e209131cea79954 |
| Δ-KNN | 0.0199 | Not recorded | 68fa78a61e209131cea79954 |
| Δ-MDS-RLog | 0.016 | Not recorded | 68fa78a61e209131cea79954 |
| RLog | 0.0159 | Not recorded | 68fa78a61e209131cea79954 |
| Δ-KNN-RLog | 0.0145 | Not recorded | 68fa78a61e209131cea79954 |

### Energy

AURC: 0.122. Result ID: 699a67995698665ec4efe464.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69cc1e209131cea24242.md>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### SIRC

AURC: 0.0848. Result ID: 699a67995698665ec4efe468.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eca1e209131cea42285.md>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### MDS

AURC: 0.0321. Result ID: 699a67995698665ec4efe465.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64f91e209131cea077ac.md>)

[Implementation](<https://github.com/pokaxpoka/deep_Mahalanobis_detector>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### MaxLogit

AURC: 0.0296. Result ID: 699a67995698665ec4efe463.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c811e209131cea34603.md>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### KNN

AURC: 0.0267. Result ID: 699a67995698665ec4efe466.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e2f1e209131cea3e69b.md>)

[Implementation](<https://github.com/deeplearning-wisc/knn-ood>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### Δ-MDS

AURC: 0.0243. Result ID: 699a67995698665ec4efe469.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### MSP

AURC: 0.0229. Result ID: 699a67995698665ec4efe462.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### Δ-KNN

AURC: 0.0199. Result ID: 699a67995698665ec4efe46a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### Δ-MDS-RLog

AURC: 0.016. Result ID: 699a67995698665ec4efe46b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### RLog

AURC: 0.0159. Result ID: 699a67995698665ec4efe467.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e61e209131cea6a860.md>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### Δ-KNN-RLog

AURC: 0.0145. Result ID: 699a67995698665ec4efe46c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

Recorded evaluation configuration: {"Backbone":"DFN CLIP","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.