# Image Classification on ImageNet-R (Metrics Aauc and Alast)

Source: [Image Classification on ImageNet-R (Metrics Aauc and Alast)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-r-metrics-aauc-and-alast>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T10:23:02.212Z

Evaluation of Image Classification performance on the ImageNet-R dataset, reporting specialized metrics Aauc and Alast.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Classification |
| Dataset (including any stated split) | ImageNet-R |
| Metric | Aauc |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 25 of 25 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Aauc](<https://www.sota2.com/research/sota/image-classification-on-imagenet-r-metrics-aauc-and-alast.md?metric=Aauc>): Higher is better; unit: PERCENT.

- [Alast](<https://www.sota2.com/research/sota/image-classification-on-imagenet-r-metrics-aauc-and-alast.md?metric=Alast>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Aauc | Result date | Report paper |
| --- | --- | --- | --- |
| SinglePrompt | 61.6 | Not recorded | 69d48faf7d0172140ec7446e |
| SinglePrompt | 59 | Not recorded | 69d48faf7d0172140ec7446e |
| SinglePrompt | 58.35 | Not recorded | 69d48faf7d0172140ec7446e |
| MISA | 57.67 | Not recorded | 69d48faf7d0172140ec7446e |
| MISA | 54.72 | Not recorded | 69d48faf7d0172140ec7446e |
| MVP | 52.47 | Not recorded | 69d48faf7d0172140ec7446e |
| MISA | 50.89 | Not recorded | 69d48faf7d0172140ec7446e |
| MVP | 49.07 | Not recorded | 69d48faf7d0172140ec7446e |
| ER | 45.74 | Not recorded | 69d48faf7d0172140ec7446e |
| ER-ACE | 43.62 | Not recorded | 69d48faf7d0172140ec7446e |
| DER++ | 42.79 | Not recorded | 69d48faf7d0172140ec7446e |
| CLIB | 42.69 | Not recorded | 69d48faf7d0172140ec7446e |
| ER-ACE | 41.06 | Not recorded | 69d48faf7d0172140ec7446e |
| MVP | 40.6 | Not recorded | 69d48faf7d0172140ec7446e |
| DER++ | 40.32 | Not recorded | 69d48faf7d0172140ec7446e |
| ER | 40.31 | Not recorded | 69d48faf7d0172140ec7446e |
| DualPrompt | 40.11 | Not recorded | 69d48faf7d0172140ec7446e |
| CLIB | 37.18 | Not recorded | 69d48faf7d0172140ec7446e |
| LwF | 31.61 | Not recorded | 69d48faf7d0172140ec7446e |
| EWC | 31.58 | Not recorded | 69d48faf7d0172140ec7446e |
| L2P | 29.65 | Not recorded | 69d48faf7d0172140ec7446e |
| Linear Probe | 29.24 | Not recorded | 69d48faf7d0172140ec7446e |
| RM | 27.88 | Not recorded | 69d48faf7d0172140ec7446e |
| RM | 18.31 | Not recorded | 69d48faf7d0172140ec7446e |
| Finetuning | 7.51 | Not recorded | 69d48faf7d0172140ec7446e |

### SinglePrompt

Aauc: 61.6. Result ID: 69d4db0347f34ce924bd4212.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

Recorded evaluation configuration: {"Buffer":"2000"}. This record does not assert independent reproduction.

### SinglePrompt

Aauc: 59. Result ID: 69d4db0347f34ce924bd4202.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

Recorded evaluation configuration: {"Buffer":"0"}. This record does not assert independent reproduction.

### SinglePrompt

Aauc: 58.35. Result ID: 69d4db0347f34ce924bd420a.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

Recorded evaluation configuration: {"Buffer":"500"}. This record does not assert independent reproduction.

### MISA

Aauc: 57.67. Result ID: 69d4db0347f34ce924bd4211.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77431e209131cea72169.md>)

Recorded evaluation configuration: {"Buffer":"2000"}. This record does not assert independent reproduction.

### MISA

Aauc: 54.72. Result ID: 69d4db0347f34ce924bd4209.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77431e209131cea72169.md>)

Recorded evaluation configuration: {"Buffer":"500"}. This record does not assert independent reproduction.

### MVP

Aauc: 52.47. Result ID: 69d4db0347f34ce924bd4210.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70561e209131cea4a5ca.md>)

Recorded evaluation configuration: {"Buffer":"2000"}. This record does not assert independent reproduction.

### MISA

Aauc: 50.89. Result ID: 69d4db0347f34ce924bd4201.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77431e209131cea72169.md>)

Recorded evaluation configuration: {"Buffer":"0"}. This record does not assert independent reproduction.

### MVP

Aauc: 49.07. Result ID: 69d4db0347f34ce924bd4208.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70561e209131cea4a5ca.md>)

Recorded evaluation configuration: {"Buffer":"500"}. This record does not assert independent reproduction.

### ER

Aauc: 45.74. Result ID: 69d4db0347f34ce924bd420b.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66b71e209131cea120af.md>)

Recorded evaluation configuration: {"Buffer":"2000"}. This record does not assert independent reproduction.

### ER-ACE

Aauc: 43.62. Result ID: 69d4db0347f34ce924bd420d.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7d1e209131cea34455.md>)

Recorded evaluation configuration: {"Buffer":"2000"}. This record does not assert independent reproduction.

### DER++

Aauc: 42.79. Result ID: 69d4db0347f34ce924bd420c.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68a11e209131cea1d3e2.md>)

[Implementation](<https://github.com/aimagelab/mammoth>)

Recorded evaluation configuration: {"Buffer":"2000"}. This record does not assert independent reproduction.

### CLIB

Aauc: 42.69. Result ID: 69d4db0347f34ce924bd420f.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f5f.md>)

Recorded evaluation configuration: {"Buffer":"2000"}. This record does not assert independent reproduction.

### ER-ACE

Aauc: 41.06. Result ID: 69d4db0347f34ce924bd4205.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7d1e209131cea34455.md>)

Recorded evaluation configuration: {"Buffer":"500"}. This record does not assert independent reproduction.

### MVP

Aauc: 40.6. Result ID: 69d4db0347f34ce924bd4200.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70561e209131cea4a5ca.md>)

Recorded evaluation configuration: {"Buffer":"0"}. This record does not assert independent reproduction.

### DER++

Aauc: 40.32. Result ID: 69d4db0347f34ce924bd4204.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68a11e209131cea1d3e2.md>)

[Implementation](<https://github.com/aimagelab/mammoth>)

Recorded evaluation configuration: {"Buffer":"500"}. This record does not assert independent reproduction.

### ER

Aauc: 40.31. Result ID: 69d4db0347f34ce924bd4203.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66b71e209131cea120af.md>)

Recorded evaluation configuration: {"Buffer":"500"}. This record does not assert independent reproduction.

### DualPrompt

Aauc: 40.11. Result ID: 69d4db0347f34ce924bd41ff.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d341e209131cea38614.md>)

Recorded evaluation configuration: {"Buffer":"0"}. This record does not assert independent reproduction.

### CLIB

Aauc: 37.18. Result ID: 69d4db0347f34ce924bd4207.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f5f.md>)

Recorded evaluation configuration: {"Buffer":"500"}. This record does not assert independent reproduction.

### LwF

Aauc: 31.61. Result ID: 69d4db0347f34ce924bd41fd.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63201e209131ce9fd0b3.md>)

Recorded evaluation configuration: {"Buffer":"0"}. This record does not assert independent reproduction.

### EWC

Aauc: 31.58. Result ID: 69d4db0347f34ce924bd41fc.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cb31e209131cea3555e.md>)

Recorded evaluation configuration: {"Buffer":"0"}. This record does not assert independent reproduction.

### L2P

Aauc: 29.65. Result ID: 69d4db0347f34ce924bd41fe.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c0c1e209131cea31ad7.md>)

[Implementation](<https://github.com/google-research/l2p>)

Recorded evaluation configuration: {"Buffer":"0"}. This record does not assert independent reproduction.

### Linear Probe

Aauc: 29.24. Result ID: 69d4db0347f34ce924bd41fb.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

Recorded evaluation configuration: {"Buffer":"0"}. This record does not assert independent reproduction.

### RM

Aauc: 27.88. Result ID: 69d4db0347f34ce924bd420e.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23509.md>)

[Implementation](<https://github.com/clovaai/rainbow-memory>)

Recorded evaluation configuration: {"Buffer":"2000"}. This record does not assert independent reproduction.

### RM

Aauc: 18.31. Result ID: 69d4db0347f34ce924bd4206.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23509.md>)

[Implementation](<https://github.com/clovaai/rainbow-memory>)

Recorded evaluation configuration: {"Buffer":"500"}. This record does not assert independent reproduction.

### Finetuning

Aauc: 7.51. Result ID: 69d4db0347f34ce924bd41fa.

[Reporting paper](<https://www.sota2.com/research/paper/69d48faf7d0172140ec7446e.md>)

Recorded evaluation configuration: {"Buffer":"0"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.