# Uncertainty Calibration on CIFAR-10.1 Source: [Uncertainty Calibration on CIFAR-10.1]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:41:21.306Z Evaluation of model uncertainty calibration performance on the CIFAR-10.1 dataset, typically measured using Expected Calibration Error (ECE). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Uncertainty Calibration | | Dataset (including any stated split) | CIFAR-10.1 | | Metric | ECE | | Unit | PERCENT | | Direction | Lower is better | | Results loaded | 27 of 27 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ECE](): Lower is better; unit: PERCENT. ## Recorded results | Method | ECE | Result date | Report paper | | --- | --- | --- | --- | | Knowledge-Transferring-based Temperature Scaling | 0.0395 | Not recorded | 68fa6f071e209131cea43629 | | ETS | 0.0425 | Not recorded | 68fa6f071e209131cea43629 | | TS-IR | 0.0454 | Not recorded | 68fa6f071e209131cea43629 | | GPC | 0.0466 | Not recorded | 68fa6f071e209131cea43629 | | TS | 0.0487 | Not recorded | 68fa6f071e209131cea43629 | | IROVA | 0.0523 | Not recorded | 68fa6f071e209131cea43629 | | IR | 0.0538 | Not recorded | 68fa6f071e209131cea43629 | | SBC | 0.0563 | Not recorded | 68fa6f071e209131cea43629 | | Knowledge-Transferring-based Temperature Scaling | 0.0574 | Not recorded | 68fa6f071e209131cea43629 | | SBC | 0.1032 | Not recorded | 68fa6f071e209131cea43629 | | TS | 0.1036 | Not recorded | 68fa6f071e209131cea43629 | | GPC | 0.1082 | Not recorded | 68fa6f071e209131cea43629 | | ETS | 0.1099 | Not recorded | 68fa6f071e209131cea43629 | | TS-IR | 0.1172 | Not recorded | 68fa6f071e209131cea43629 | | IROVA | 0.127 | Not recorded | 68fa6f071e209131cea43629 | | IR | 0.1335 | Not recorded | 68fa6f071e209131cea43629 | | Base | 0.138 | Not recorded | 68fa6f071e209131cea43629 | | Knowledge-Transferring-based Temperature Scaling | 0.1386 | Not recorded | 68fa6f071e209131cea43629 | | GPC | 0.1571 | Not recorded | 68fa6f071e209131cea43629 | | TS-IR | 0.1665 | Not recorded | 68fa6f071e209131cea43629 | | ETS | 0.167 | Not recorded | 68fa6f071e209131cea43629 | | TS | 0.1675 | Not recorded | 68fa6f071e209131cea43629 | | SBC | 0.1678 | Not recorded | 68fa6f071e209131cea43629 | | IR | 0.1713 | Not recorded | 68fa6f071e209131cea43629 | | IROVA | 0.1793 | Not recorded | 68fa6f071e209131cea43629 | | Base | 0.2279 | Not recorded | 68fa6f071e209131cea43629 | | Base | 0.2897 | Not recorded | 68fa6f071e209131cea43629 | ### Knowledge-Transferring-based Temperature Scaling ECE: 0.0395. Result ID: 69907d0a3a6c31484900eacb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"IF":10}. This record does not assert independent reproduction. ### ETS ECE: 0.0425. Result ID: 69907d0a3a6c31484900eac5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":10}. This record does not assert independent reproduction. ### TS-IR ECE: 0.0454. Result ID: 69907d0a3a6c31484900eac6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":10}. This record does not assert independent reproduction. ### GPC ECE: 0.0466. Result ID: 69907d0a3a6c31484900eaca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":10}. This record does not assert independent reproduction. ### TS ECE: 0.0487. Result ID: 69907d0a3a6c31484900eac4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":10}. This record does not assert independent reproduction. ### IROVA ECE: 0.0523. Result ID: 69907d0a3a6c31484900eac8. [Reporting paper]() Recorded evaluation configuration: {"IF":10}. This record does not assert independent reproduction. ### IR ECE: 0.0538. Result ID: 69907d0a3a6c31484900eac7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":10}. This record does not assert independent reproduction. ### SBC ECE: 0.0563. Result ID: 69907d0a3a6c31484900eac9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":10}. This record does not assert independent reproduction. ### Knowledge-Transferring-based Temperature Scaling ECE: 0.0574. Result ID: 69907d0a3a6c31484900eac2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"IF":50}. This record does not assert independent reproduction. ### SBC ECE: 0.1032. Result ID: 69907d0a3a6c31484900eac0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":50}. This record does not assert independent reproduction. ### TS ECE: 0.1036. Result ID: 69907d0a3a6c31484900eabb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":50}. This record does not assert independent reproduction. ### GPC ECE: 0.1082. Result ID: 69907d0a3a6c31484900eac1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":50}. This record does not assert independent reproduction. ### ETS ECE: 0.1099. Result ID: 69907d0a3a6c31484900eabc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":50}. This record does not assert independent reproduction. ### TS-IR ECE: 0.1172. Result ID: 69907d0a3a6c31484900eabd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":50}. This record does not assert independent reproduction. ### IROVA ECE: 0.127. Result ID: 69907d0a3a6c31484900eabf. [Reporting paper]() Recorded evaluation configuration: {"IF":50}. This record does not assert independent reproduction. ### IR ECE: 0.1335. Result ID: 69907d0a3a6c31484900eabe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":50}. This record does not assert independent reproduction. ### Base ECE: 0.138. Result ID: 69907d0a3a6c31484900eac3. [Reporting paper]() Recorded evaluation configuration: {"IF":10}. This record does not assert independent reproduction. ### Knowledge-Transferring-based Temperature Scaling ECE: 0.1386. Result ID: 69907d0a3a6c31484900eab9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"IF":100}. This record does not assert independent reproduction. ### GPC ECE: 0.1571. Result ID: 69907d0a3a6c31484900eab8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":100}. This record does not assert independent reproduction. ### TS-IR ECE: 0.1665. Result ID: 69907d0a3a6c31484900eab4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":100}. This record does not assert independent reproduction. ### ETS ECE: 0.167. Result ID: 69907d0a3a6c31484900eab3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":100}. This record does not assert independent reproduction. ### TS ECE: 0.1675. Result ID: 69907d0a3a6c31484900eab2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":100}. This record does not assert independent reproduction. ### SBC ECE: 0.1678. Result ID: 69907d0a3a6c31484900eab7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":100}. This record does not assert independent reproduction. ### IR ECE: 0.1713. Result ID: 69907d0a3a6c31484900eab5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"IF":100}. This record does not assert independent reproduction. ### IROVA ECE: 0.1793. Result ID: 69907d0a3a6c31484900eab6. [Reporting paper]() Recorded evaluation configuration: {"IF":100}. This record does not assert independent reproduction. ### Base ECE: 0.2279. Result ID: 69907d0a3a6c31484900eaba. [Reporting paper]() Recorded evaluation configuration: {"IF":50}. This record does not assert independent reproduction. ### Base ECE: 0.2897. Result ID: 69907d0a3a6c31484900eab1. [Reporting paper]() Recorded evaluation configuration: {"IF":100}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.