# Selective Classification on ImageNet-S

Source: [Selective Classification on ImageNet-S](<https://www.sota2.com/research/sota/selective-classification-on-imagenet-s>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:25:44.440Z

Evaluation of Selective Classification performance on the ImageNet-S dataset, measured using AURC and NAURC metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Selective Classification |
| Dataset (including any stated split) | ImageNet-S |
| Metric | AURC |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AURC](<https://www.sota2.com/research/sota/selective-classification-on-imagenet-s.md?metric=AURC>): Higher is better; unit: SCALAR.

- [NAURC](<https://www.sota2.com/research/sota/selective-classification-on-imagenet-s.md?metric=NAURC>): Higher is better; unit: SCALAR.

## Recorded results

| Method | AURC | Result date | Report paper |
| --- | --- | --- | --- |
| Energy | 14 | Not recorded | 68fa78a61e209131cea79954 |
| MaxLogit | 10.3 | Not recorded | 68fa78a61e209131cea79954 |
| SIRC | 8.71 | Not recorded | 68fa78a61e209131cea79954 |
| MSP | 8.15 | Not recorded | 68fa78a61e209131cea79954 |
| MDS | 7.26 | Not recorded | 68fa78a61e209131cea79954 |
| KNN | 7.15 | Not recorded | 68fa78a61e209131cea79954 |
| Δ-KNN | 5.91 | Not recorded | 68fa78a61e209131cea79954 |
| RLog | 5.9 | Not recorded | 68fa78a61e209131cea79954 |
| Δ-MDS | 5.76 | Not recorded | 68fa78a61e209131cea79954 |
| Δ-KNN-RLog | 5.63 | Not recorded | 68fa78a61e209131cea79954 |
| Δ-MDS-RLog | 5.45 | Not recorded | 68fa78a61e209131cea79954 |

### Energy

AURC: 14. Result ID: 699a67995698665ec4efe413.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69cc1e209131cea24242.md>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### MaxLogit

AURC: 10.3. Result ID: 699a67995698665ec4efe412.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c811e209131cea34603.md>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### SIRC

AURC: 8.71. Result ID: 699a67995698665ec4efe417.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eca1e209131cea42285.md>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### MSP

AURC: 8.15. Result ID: 699a67995698665ec4efe411.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64e41e209131cea0731a.md>)

[Implementation](<https://www.sota2.com/github.com/hendrycks/error-detection>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### MDS

AURC: 7.26. Result ID: 699a67995698665ec4efe414.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64f91e209131cea077ac.md>)

[Implementation](<https://github.com/pokaxpoka/deep_Mahalanobis_detector>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### KNN

AURC: 7.15. Result ID: 699a67995698665ec4efe415.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e2f1e209131cea3e69b.md>)

[Implementation](<https://github.com/deeplearning-wisc/knn-ood>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### Δ-KNN

AURC: 5.91. Result ID: 699a67995698665ec4efe419.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### RLog

AURC: 5.9. Result ID: 699a67995698665ec4efe416.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e61e209131cea6a860.md>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### Δ-MDS

AURC: 5.76. Result ID: 699a67995698665ec4efe418.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### Δ-KNN-RLog

AURC: 5.63. Result ID: 699a67995698665ec4efe41b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

### Δ-MDS-RLog

AURC: 5.45. Result ID: 699a67995698665ec4efe41a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a61e209131cea79954.md>)

Recorded evaluation configuration: {"Backbone":"EVA","Protocol":"Supervised learning","Coverage":"Full"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.