# Uncertainty Calibration on ImageNet-R

Source: [Uncertainty Calibration on ImageNet-R](<https://www.sota2.com/research/sota/uncertainty-calibration-on-imagenet-r>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:41:22.272Z

Evaluation of model uncertainty calibration performance on the ImageNet-R dataset, typically measured using Expected Calibration Error (ECE).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Uncertainty Calibration |
| Dataset (including any stated split) | ImageNet-R |
| Metric | ECE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ECE](<https://www.sota2.com/research/sota/uncertainty-calibration-on-imagenet-r.md?metric=ECE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | ECE | Result date | Report paper |
| --- | --- | --- | --- |
| CLAP (Ours) + MaPLe | 0.146 | Not recorded | 68fa757a1e209131cea683c5 |
| MaPLe | 0.149 | Not recorded | 68fa757a1e209131cea683c5 |
| CLAP (Ours) + AttriCLIP | 0.19 | Not recorded | 68fa757a1e209131cea683c5 |
| CoOp | 0.191 | Not recorded | 68fa757a1e209131cea683c5 |
| CLAP (Ours) + Continual-CLIP | 0.201 | Not recorded | 68fa757a1e209131cea683c5 |
| AttriCLIP | 0.205 | Not recorded | 68fa757a1e209131cea683c5 |
| Continual-CLIP | 0.206 | Not recorded | 68fa757a1e209131cea683c5 |
| CLAP (Ours) + CoOp | 0.207 | Not recorded | 68fa757a1e209131cea683c5 |

### CLAP (Ours) + MaPLe

ECE: 0.146. Result ID: 6993c9a23a6c3148491888d8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Implementation](<https://github.com/srvCodes/clap4clip>)

Recorded evaluation configuration: {"Base method":"MaPLe","Prompt-based finetuning":"true"}. This record does not assert independent reproduction.

### MaPLe

ECE: 0.149. Result ID: 6993c9a23a6c3148491888d7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef21e209131cea4311c.md>)

[Implementation](<https://github.com/muzairkhattak/multimodal-prompt-learning>)

Recorded evaluation configuration: {"Prompt-based finetuning":"true"}. This record does not assert independent reproduction.

### CLAP (Ours) + AttriCLIP

ECE: 0.19. Result ID: 6993c9a23a6c3148491888da.

[Reporting paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Implementation](<https://github.com/srvCodes/clap4clip>)

Recorded evaluation configuration: {"Base method":"AttriCLIP","Prompt-based finetuning":"true"}. This record does not assert independent reproduction.

### CoOp

ECE: 0.191. Result ID: 6993c9a23a6c3148491888d5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d8b1e209131cea3a814.md>)

[Implementation](<https://github.com/KaiyangZhou/CoOp>)

Recorded evaluation configuration: {"Prompt-based finetuning":"true"}. This record does not assert independent reproduction.

### CLAP (Ours) + Continual-CLIP

ECE: 0.201. Result ID: 6993c9a23a6c3148491888d4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Implementation](<https://github.com/srvCodes/clap4clip>)

Recorded evaluation configuration: {"Base method":"Continual-CLIP","Prompt-based finetuning":"true"}. This record does not assert independent reproduction.

### AttriCLIP

ECE: 0.205. Result ID: 6993c9a23a6c3148491888d9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72911e209131cea57225.md>)

[Implementation](<https://github.com/bhrqw/AttriCLIP>)

Recorded evaluation configuration: {"Prompt-based finetuning":"true"}. This record does not assert independent reproduction.

### Continual-CLIP

ECE: 0.206. Result ID: 6993c9a23a6c3148491888d3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d8e1e209131cea3a917.md>)

Recorded evaluation configuration: {"Prompt-based finetuning":"true"}. This record does not assert independent reproduction.

### CLAP (Ours) + CoOp

ECE: 0.207. Result ID: 6993c9a23a6c3148491888d6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757a1e209131cea683c5.md>)

[Implementation](<https://github.com/srvCodes/clap4clip>)

Recorded evaluation configuration: {"Base method":"CoOp","Prompt-based finetuning":"true"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.