# Calibration on ImageNet-Sketch (test) Source: [Calibration on ImageNet-Sketch (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:41:21.845Z Evaluation of model calibration performance on the test split of the ImageNet-Sketch dataset, typically measured using ECE, ACE, MCE, and PIECE. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Calibration | | Dataset (including any stated split) | ImageNet-Sketch (test) | | Metric | ECE | | Unit | PERCENT | | Direction | Lower is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ECE](): Lower is better; unit: PERCENT. - [ACE](): Lower is better; unit: PERCENT. - [MCE](): Lower is better; unit: PERCENT. - [PIECE](): Lower is better; unit: PERCENT. ## Recorded results | Method | ECE | Result date | Report paper | | --- | --- | --- | --- | | MIR | 0.28 | Not recorded | 68fa72941e209131cea573f5 | | PTSK | 1.15 | Not recorded | 68fa72941e209131cea573f5 | | MIR | 1.22 | Not recorded | 68fa72941e209131cea573f5 | | PTS | 1.6 | Not recorded | 68fa72941e209131cea573f5 | | PTS | 1.62 | Not recorded | 68fa72941e209131cea573f5 | | Conf | 1.96 | Not recorded | 68fa72941e209131cea573f5 | | ETS | 2.07 | Not recorded | 68fa72941e209131cea573f5 | | TS | 2.38 | Not recorded | 68fa72941e209131cea573f5 | | PTSK | 3.14 | Not recorded | 68fa72941e209131cea573f5 | | ETS | 3.16 | Not recorded | 68fa72941e209131cea573f5 | | Conf | 3.91 | Not recorded | 68fa72941e209131cea573f5 | | TS | 7.6 | Not recorded | 68fa72941e209131cea573f5 | ### MIR ECE: 0.28. Result ID: 699243553a6c3148490dbc5d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"Base"}. This record does not assert independent reproduction. ### PTSK ECE: 1.15. Result ID: 699243553a6c3148490dbc5c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"PROCAL"}. This record does not assert independent reproduction. ### MIR ECE: 1.22. Result ID: 699243553a6c3148490dbc5e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"PROCAL"}. This record does not assert independent reproduction. ### PTS ECE: 1.6. Result ID: 699243553a6c3148490dbc5a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"PROCAL"}. This record does not assert independent reproduction. ### PTS ECE: 1.62. Result ID: 699243553a6c3148490dbc59. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"Base"}. This record does not assert independent reproduction. ### Conf ECE: 1.96. Result ID: 699243553a6c3148490dbc54. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"PROCAL"}. This record does not assert independent reproduction. ### ETS ECE: 2.07. Result ID: 699243553a6c3148490dbc58. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"PROCAL"}. This record does not assert independent reproduction. ### TS ECE: 2.38. Result ID: 699243553a6c3148490dbc56. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"PROCAL"}. This record does not assert independent reproduction. ### PTSK ECE: 3.14. Result ID: 699243553a6c3148490dbc5b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"Base"}. This record does not assert independent reproduction. ### ETS ECE: 3.16. Result ID: 699243553a6c3148490dbc57. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"Base"}. This record does not assert independent reproduction. ### Conf ECE: 3.91. Result ID: 699243553a6c3148490dbc53. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"Base"}. This record does not assert independent reproduction. ### TS ECE: 7.6. Result ID: 699243553a6c3148490dbc55. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-Large (vit\_large\_patch14\_clip\_336)","Integration":"Base"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.