# Conformal Prediction on synthetic data 5-class Example 2 covariate shift a=0.5 Easy Bin (r\* \> 0.5) Source: [Conformal Prediction on synthetic data 5-class Example 2 covariate shift a=0.5 Easy Bin (r\* \> 0.5)]() Collection index: [llms.txt]() Data updated: 2026-06-16T07:01:14.630Z Evaluation of Conformal Prediction performance on the synthetic dataset variant 'Example 2' characterized by 5 classes, a covariate shift parameter a=0.5, evaluated specifically on the 'Easy Bin (r\* \> 0.5)' subset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Conformal Prediction | | Dataset (including any stated split) | synthetic data 5-class Example 2 covariate shift a=0.5 Easy Bin (r\* \> 0.5) | | Metric | Coverage | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Coverage](): Higher is better; unit: PERCENT. - [Size](): Lower is better; unit: SIZE. ## Recorded results | Method | Coverage | Result date | Report paper | | --- | --- | --- | --- | | Standard | 96.6 | Not recorded | 6a30d896d33dfb23e783cc51 | | Standard | 96.6 | Not recorded | 6a30d896d33dfb23e783cc51 | | Standard | 96.6 | Not recorded | 6a30d896d33dfb23e783cc51 | | Standard | 96.6 | Not recorded | 6a30d896d33dfb23e783cc51 | | Standard | 96.5 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 96 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 95.9 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 95.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 95.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 95.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 95.7 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 95.6 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 95.2 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 95 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 94.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 94.6 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-ACC | 94.5 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 94.5 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 94.3 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-ACC | 94 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-ACC | 93.9 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-ACC | 93.7 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 93.4 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-ACC | 93.4 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 93.2 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 92.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 92.6 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 92.2 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 91.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 88.5 | Not recorded | 6a30d896d33dfb23e783cc51 | ### Standard Coverage: 96.6. Result ID: 6a30f4b7fbc373592c2ca07d. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### Standard Coverage: 96.6. Result ID: 6a30f4b7fbc373592c2ca083. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### Standard Coverage: 96.6. Result ID: 6a30f4b7fbc373592c2ca089. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### Standard Coverage: 96.6. Result ID: 6a30f4b7fbc373592c2ca095. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"5000"}. This record does not assert independent reproduction. ### Standard Coverage: 96.5. Result ID: 6a30f4b7fbc373592c2ca08f. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### Retrain Coverage: 96. Result ID: 6a30f4b7fbc373592c2ca088. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### AdaTS Coverage: 95.9. Result ID: 6a30f4b7fbc373592c2ca07b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### AdaTS Coverage: 95.8. Result ID: 6a30f4b7fbc373592c2ca081. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### AdaTS Coverage: 95.8. Result ID: 6a30f4b7fbc373592c2ca087. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### AdaTS Coverage: 95.8. Result ID: 6a30f4b7fbc373592c2ca093. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"5000"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 95.7. Result ID: 6a30f4b7fbc373592c2ca079. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### AdaTS Coverage: 95.6. Result ID: 6a30f4b7fbc373592c2ca08d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 95.2. Result ID: 6a30f4b7fbc373592c2ca07f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 95. Result ID: 6a30f4b7fbc373592c2ca085. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### Retrain Coverage: 94.8. Result ID: 6a30f4b7fbc373592c2ca08e. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 94.6. Result ID: 6a30f4b7fbc373592c2ca07a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### ACP-ACC Coverage: 94.5. Result ID: 6a30f4b7fbc373592c2ca078. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 94.5. Result ID: 6a30f4b7fbc373592c2ca08b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 94.3. Result ID: 6a30f4b7fbc373592c2ca091. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"5000"}. This record does not assert independent reproduction. ### ACP-ACC Coverage: 94. Result ID: 6a30f4b7fbc373592c2ca07e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### ACP-ACC Coverage: 93.9. Result ID: 6a30f4b7fbc373592c2ca084. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### ACP-ACC Coverage: 93.7. Result ID: 6a30f4b7fbc373592c2ca08a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 93.4. Result ID: 6a30f4b7fbc373592c2ca080. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### ACP-ACC Coverage: 93.4. Result ID: 6a30f4b7fbc373592c2ca090. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"5000"}. This record does not assert independent reproduction. ### Retrain Coverage: 93.2. Result ID: 6a30f4b7fbc373592c2ca094. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"5000"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 92.8. Result ID: 6a30f4b7fbc373592c2ca086. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 92.6. Result ID: 6a30f4b7fbc373592c2ca08c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 92.2. Result ID: 6a30f4b7fbc373592c2ca092. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"5000"}. This record does not assert independent reproduction. ### Retrain Coverage: 91.8. Result ID: 6a30f4b7fbc373592c2ca082. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### Retrain Coverage: 88.5. Result ID: 6a30f4b7fbc373592c2ca07c. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.