# Conformal Prediction on ImageNet ILSVRC2012 (test) Source: [Conformal Prediction on ImageNet ILSVRC2012 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:36:18.181Z Evaluation of Conformal Prediction methods on the test split of the ImageNet ILSVRC2012 dataset, focusing on uncertainty quantification metrics like average prediction set size. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Conformal Prediction | | Dataset (including any stated split) | ImageNet ILSVRC2012 (test) | | Metric | Avg Prediction Set Size | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Avg Prediction Set Size](): Lower is better; unit: SCALAR. ## Recorded results | Method | Avg Prediction Set Size | Result date | Report paper | | --- | --- | --- | --- | | RAPS+TTA-Learned | 2.312 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Avg | 2.327 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Learned | 2.362 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Avg | 2.47 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS | 2.548 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS | 2.548 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Learned | 4.889 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Avg | 4.908 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Learned | 5.04 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Avg | 5.318 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS | 5.637 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS | 5.637 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Learned | 31.248 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Avg | 31.681 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Learned | 32.702 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS+TTA-Avg | 35.6 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS | 37.751 | Not recorded | 68fa78eb1e209131cea7b3a0 | | RAPS | 37.751 | Not recorded | 68fa78eb1e209131cea7b3a0 | ### RAPS+TTA-Learned Avg Prediction Set Size: 2.312. Result ID: 6995af333badfaffe6ae684b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.1,"Augmentation Policy":"Expanded Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Avg Avg Prediction Set Size: 2.327. Result ID: 6995af333badfaffe6ae6853. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.1,"Augmentation Policy":"Simple Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Learned Avg Prediction Set Size: 2.362. Result ID: 6995af333badfaffe6ae6854. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.1,"Augmentation Policy":"Simple Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Avg Avg Prediction Set Size: 2.47. Result ID: 6995af333badfaffe6ae684a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.1,"Augmentation Policy":"Expanded Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS Avg Prediction Set Size: 2.548. Result ID: 6995af333badfaffe6ae6849. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.1,"Augmentation Policy":"Expanded Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS Avg Prediction Set Size: 2.548. Result ID: 6995af333badfaffe6ae6852. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.1,"Augmentation Policy":"Simple Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Learned Avg Prediction Set Size: 4.889. Result ID: 6995af333badfaffe6ae6848. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.05,"Augmentation Policy":"Expanded Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Avg Avg Prediction Set Size: 4.908. Result ID: 6995af333badfaffe6ae6850. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.05,"Augmentation Policy":"Simple Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Learned Avg Prediction Set Size: 5.04. Result ID: 6995af333badfaffe6ae6851. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.05,"Augmentation Policy":"Simple Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Avg Avg Prediction Set Size: 5.318. Result ID: 6995af333badfaffe6ae6847. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.05,"Augmentation Policy":"Expanded Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS Avg Prediction Set Size: 5.637. Result ID: 6995af333badfaffe6ae6846. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.05,"Augmentation Policy":"Expanded Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS Avg Prediction Set Size: 5.637. Result ID: 6995af333badfaffe6ae684f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.05,"Augmentation Policy":"Simple Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Learned Avg Prediction Set Size: 31.248. Result ID: 6995af333badfaffe6ae6845. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.01,"Augmentation Policy":"Expanded Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Avg Avg Prediction Set Size: 31.681. Result ID: 6995af333badfaffe6ae684d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.01,"Augmentation Policy":"Simple Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Learned Avg Prediction Set Size: 32.702. Result ID: 6995af333badfaffe6ae684e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.01,"Augmentation Policy":"Simple Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS+TTA-Avg Avg Prediction Set Size: 35.6. Result ID: 6995af333badfaffe6ae6844. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.01,"Augmentation Policy":"Expanded Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS Avg Prediction Set Size: 37.751. Result ID: 6995af333badfaffe6ae6843. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.01,"Augmentation Policy":"Expanded Augmentation Policy"}. This record does not assert independent reproduction. ### RAPS Avg Prediction Set Size: 37.751. Result ID: 6995af333badfaffe6ae684c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Alpha":0.01,"Augmentation Policy":"Simple Augmentation Policy"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.