# Transferability Estimation on ImageNet-C Severity 1 1.0

Source: [Transferability Estimation on ImageNet-C Severity 1 1.0](<https://www.sota2.com/research/sota/transferability-estimation-on-imagenet-c-severity-1-1-0>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-25T07:37:14.792Z

Evaluation of model transferability estimation capabilities using the ImageNet-C dataset corrupted at Severity 1.0, measured by Mean Correlation Improvement (MCI).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Transferability Estimation |
| Dataset (including any stated split) | ImageNet-C Severity 1 1.0 |
| Metric | Mean Correlation Improvement (MCI) |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Mean Correlation Improvement (MCI)](<https://www.sota2.com/research/sota/transferability-estimation-on-imagenet-c-severity-1-1-0.md?metric=Mean%20Correlation%20Improvement%20(MCI)>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Mean Correlation Improvement (MCI) | Result date | Report paper |
| --- | --- | --- | --- |
| S-OTDD | 20.61 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| S-OTDD | 19.2 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| LogME | 17.06 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| LogME | 13.43 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| Reg. H-Score | 12.44 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| NCE | 12.21 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| TransRate | 10.57 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| H-Score | 9.46 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| LEEP | 7.61 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| RADAR | 7.61 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| TransRate | 7.54 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| LEEP | 5.13 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| NCE | 2.87 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| RADAR | -0.25 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| H-Score | -1.1 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |
| Reg. H-Score | -1.82 | Not recorded | 6a13d7896f71c5ae7dc9e8a4 |

### S-OTDD

Mean Correlation Improvement (MCI): 20.61. Result ID: 6a13fbf1fbc373592c0ad2d8.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78951e209131cea79140.md>)

Recorded evaluation configuration: {"Architecture":"DINOv3"}. This record does not assert independent reproduction.

### S-OTDD

Mean Correlation Improvement (MCI): 19.2. Result ID: 6a13fbf1fbc373592c0ad2d7.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78951e209131cea79140.md>)

Recorded evaluation configuration: {"Architecture":"CLIP"}. This record does not assert independent reproduction.

### LogME

Mean Correlation Improvement (MCI): 17.06. Result ID: 6a13fbf1fbc373592c0ad2d2.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a381e209131cea26a62.md>)

[Implementation](<https://github.com/thuml/LogME>)

Recorded evaluation configuration: {"Architecture":"DINOv3"}. This record does not assert independent reproduction.

### LogME

Mean Correlation Improvement (MCI): 13.43. Result ID: 6a13fbf1fbc373592c0ad2d1.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a381e209131cea26a62.md>)

[Implementation](<https://github.com/thuml/LogME>)

Recorded evaluation configuration: {"Architecture":"CLIP"}. This record does not assert independent reproduction.

### Reg. H-Score

Mean Correlation Improvement (MCI): 12.44. Result ID: 6a13fbf1fbc373592c0ad2cf.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7e1e209131cea45f4e.md>)

Recorded evaluation configuration: {"Architecture":"CLIP"}. This record does not assert independent reproduction.

### NCE

Mean Correlation Improvement (MCI): 12.21. Result ID: 6a13fbf1fbc373592c0ad2d3.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66391e209131cea0eecb.md>)

Recorded evaluation configuration: {"Architecture":"CLIP"}. This record does not assert independent reproduction.

### TransRate

Mean Correlation Improvement (MCI): 10.57. Result ID: 6a13fbf1fbc373592c0ad2d5.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cf91e209131cea37035.md>)

Recorded evaluation configuration: {"Architecture":"CLIP"}. This record does not assert independent reproduction.

### H-Score

Mean Correlation Improvement (MCI): 9.46. Result ID: 6a13fbf1fbc373592c0ad2cd.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e3a1e209131cea3e7df.md>)

Recorded evaluation configuration: {"Architecture":"CLIP"}. This record does not assert independent reproduction.

### LEEP

Mean Correlation Improvement (MCI): 7.61. Result ID: 6a13fbf1fbc373592c0ad2cb.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa682f1e209131cea1a9fc.md>)

Recorded evaluation configuration: {"Architecture":"CLIP"}. This record does not assert independent reproduction.

### RADAR

Mean Correlation Improvement (MCI): 7.61. Result ID: 6a13fbf1fbc373592c0ad2d9.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

Recorded evaluation configuration: {"Architecture":"CLIP"}. This record does not assert independent reproduction.

### TransRate

Mean Correlation Improvement (MCI): 7.54. Result ID: 6a13fbf1fbc373592c0ad2d6.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cf91e209131cea37035.md>)

Recorded evaluation configuration: {"Architecture":"DINOv3"}. This record does not assert independent reproduction.

### LEEP

Mean Correlation Improvement (MCI): 5.13. Result ID: 6a13fbf1fbc373592c0ad2cc.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa682f1e209131cea1a9fc.md>)

Recorded evaluation configuration: {"Architecture":"DINOv3"}. This record does not assert independent reproduction.

### NCE

Mean Correlation Improvement (MCI): 2.87. Result ID: 6a13fbf1fbc373592c0ad2d4.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66391e209131cea0eecb.md>)

Recorded evaluation configuration: {"Architecture":"DINOv3"}. This record does not assert independent reproduction.

### RADAR

Mean Correlation Improvement (MCI): -0.25. Result ID: 6a13fbf1fbc373592c0ad2da.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

Recorded evaluation configuration: {"Architecture":"DINOv3"}. This record does not assert independent reproduction.

### H-Score

Mean Correlation Improvement (MCI): -1.1. Result ID: 6a13fbf1fbc373592c0ad2ce.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e3a1e209131cea3e7df.md>)

Recorded evaluation configuration: {"Architecture":"DINOv3"}. This record does not assert independent reproduction.

### Reg. H-Score

Mean Correlation Improvement (MCI): -1.82. Result ID: 6a13fbf1fbc373592c0ad2d0.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7896f71c5ae7dc9e8a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7e1e209131cea45f4e.md>)

Recorded evaluation configuration: {"Architecture":"DINOv3"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
