# Conformal Prediction on Camelyon17 (0.33 \< r\* ≤ 0.67) (test) Source: [Conformal Prediction on Camelyon17 (0.33 \< r\* ≤ 0.67) (test)]() Collection index: [llms.txt]() Data updated: 2026-06-16T07:01:15.504Z Evaluation of Conformal Prediction methods on the test split of Camelyon17, specifically focusing on the subset where the coverage radius r\* falls between 0.33 and 0.67. Metrics reported are Coverage and Size. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Conformal Prediction | | Dataset (including any stated split) | Camelyon17 (0.33 \< r\* ≤ 0.67) (test) | | Metric | Coverage | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Coverage](): Higher is better; unit: PERCENT. - [Size](): Lower is better; unit: SCALAR. ## Recorded results | Method | Coverage | Result date | Report paper | | --- | --- | --- | --- | | ACP-ACC | 88.2 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-ACC | 87.4 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-ACC | 86.1 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 85.1 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 85 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-ACC | 83.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-ACC | 83.1 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 82.7 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 81.9 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 80.7 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 79.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 79.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 77.4 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 76.5 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 76 | Not recorded | 6a30d896d33dfb23e783cc51 | | Retrain | 75.4 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 74.3 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 72.4 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-AEC | 71.7 | Not recorded | 6a30d896d33dfb23e783cc51 | | ACP-MC | 68.9 | Not recorded | 6a30d896d33dfb23e783cc51 | | Standard | 67.7 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 67.4 | Not recorded | 6a30d896d33dfb23e783cc51 | | Standard | 64.5 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 64.4 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 64.3 | Not recorded | 6a30d896d33dfb23e783cc51 | | Standard | 63.8 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 63.3 | Not recorded | 6a30d896d33dfb23e783cc51 | | Standard | 63 | Not recorded | 6a30d896d33dfb23e783cc51 | | Standard | 61.6 | Not recorded | 6a30d896d33dfb23e783cc51 | | AdaTS | 61.4 | Not recorded | 6a30d896d33dfb23e783cc51 | ### ACP-ACC Coverage: 88.2. Result ID: 6a30f4b7fbc373592c2ca306. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### ACP-ACC Coverage: 87.4. Result ID: 6a30f4b7fbc373592c2ca300. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### ACP-ACC Coverage: 86.1. Result ID: 6a30f4b7fbc373592c2ca2fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"300"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 85.1. Result ID: 6a30f4b7fbc373592c2ca30e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### Retrain Coverage: 85. Result ID: 6a30f4b7fbc373592c2ca310. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### ACP-ACC Coverage: 83.8. Result ID: 6a30f4b7fbc373592c2ca30c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### ACP-ACC Coverage: 83.1. Result ID: 6a30f4b7fbc373592c2ca2f4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 82.7. Result ID: 6a30f4b7fbc373592c2ca30d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 81.9. Result ID: 6a30f4b7fbc373592c2ca308. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 80.7. Result ID: 6a30f4b7fbc373592c2ca307. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 79.8. Result ID: 6a30f4b7fbc373592c2ca301. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### Retrain Coverage: 79.8. Result ID: 6a30f4b7fbc373592c2ca30a. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 77.4. Result ID: 6a30f4b7fbc373592c2ca302. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### Retrain Coverage: 76.5. Result ID: 6a30f4b7fbc373592c2ca2fe. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"300"}. This record does not assert independent reproduction. ### Retrain Coverage: 76. Result ID: 6a30f4b7fbc373592c2ca304. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### Retrain Coverage: 75.4. Result ID: 6a30f4b7fbc373592c2ca2f8. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 74.3. Result ID: 6a30f4b7fbc373592c2ca2fb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"300"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 72.4. Result ID: 6a30f4b7fbc373592c2ca2fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"300"}. This record does not assert independent reproduction. ### ACP-AEC Coverage: 71.7. Result ID: 6a30f4b7fbc373592c2ca2f5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### ACP-MC Coverage: 68.9. Result ID: 6a30f4b7fbc373592c2ca2f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### Standard Coverage: 67.7. Result ID: 6a30f4b7fbc373592c2ca311. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### AdaTS Coverage: 67.4. Result ID: 6a30f4b7fbc373592c2ca30f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"2000"}. This record does not assert independent reproduction. ### Standard Coverage: 64.5. Result ID: 6a30f4b7fbc373592c2ca2ff. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"300"}. This record does not assert independent reproduction. ### AdaTS Coverage: 64.4. Result ID: 6a30f4b7fbc373592c2ca309. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### AdaTS Coverage: 64.3. Result ID: 6a30f4b7fbc373592c2ca2fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"300"}. This record does not assert independent reproduction. ### Standard Coverage: 63.8. Result ID: 6a30f4b7fbc373592c2ca30b. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"1000"}. This record does not assert independent reproduction. ### AdaTS Coverage: 63.3. Result ID: 6a30f4b7fbc373592c2ca2f7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### Standard Coverage: 63. Result ID: 6a30f4b7fbc373592c2ca2f9. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"200"}. This record does not assert independent reproduction. ### Standard Coverage: 61.6. Result ID: 6a30f4b7fbc373592c2ca305. [Reporting paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. ### AdaTS Coverage: 61.4. Result ID: 6a30f4b7fbc373592c2ca303. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Calibration Samples":"500"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.