Conformal Prediction on Camelyon17 (0.33 < r* ≤ 0.67) (test)
88.2CoverageACP-ACC
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ACP-ACCNumber of Calibration Samples=10002026.06 | 88.2 | 1.811 | |
| ACP-ACCNumber of Calibration Samples=5002026.06 | 87.4 | 1.801 | |
| ACP-ACCNumber of Calibration Samples=3002026.06 | 86.1 | 1.779 | |
| ACP-MCNumber of Calibration Samples=20002026.06 | 85.1 | 1.615 | |
| RetrainNumber of Calibration Samples=20002026.06 | 85 | 1.435 | |
| ACP-ACCNumber of Calibration Samples=20002026.06 | 83.8 | 1.726 | |
| ACP-ACCNumber of Calibration Samples=2002026.06 | 83.1 | 1.751 | |
| ACP-AECNumber of Calibration Samples=20002026.06 | 82.7 | 1.685 | |
| ACP-MCNumber of Calibration Samples=10002026.06 | 81.9 | 1.588 | |
| ACP-AECNumber of Calibration Samples=10002026.06 | 80.7 | 1.689 | |
| ACP-AECNumber of Calibration Samples=5002026.06 | 79.8 | 1.678 | |
| RetrainNumber of Calibration Samples=10002026.06 | 79.8 | 1.462 | |
| ACP-MCNumber of Calibration Samples=5002026.06 | 77.4 | 1.537 | |
| RetrainNumber of Calibration Samples=3002026.06 | 76.5 | 1.386 | |
| RetrainNumber of Calibration Samples=5002026.06 | 76 | 1.373 | |
| RetrainNumber of Calibration Samples=2002026.06 | 75.4 | 1.343 | |
| ACP-AECNumber of Calibration Samples=3002026.06 | 74.3 | 1.584 | |
| ACP-MCNumber of Calibration Samples=3002026.06 | 72.4 | 1.487 | |
| ACP-AECNumber of Calibration Samples=2002026.06 | 71.7 | 1.541 | |
| ACP-MCNumber of Calibration Samples=2002026.06 | 68.9 | 1.441 | |
| StandardNumber of Calibration Samples=20002026.06 | 67.7 | 1.466 | |
| AdaTSNumber of Calibration Samples=20002026.06 | 67.4 | 1.457 | |
| StandardNumber of Calibration Samples=3002026.06 | 64.5 | 1.436 | |
| AdaTSNumber of Calibration Samples=10002026.06 | 64.4 | 1.413 | |
| AdaTSNumber of Calibration Samples=3002026.06 | 64.3 | 1.436 | |
| StandardNumber of Calibration Samples=10002026.06 | 63.8 | 1.412 | |
| AdaTSNumber of Calibration Samples=2002026.06 | 63.3 | 1.378 | |
| StandardNumber of Calibration Samples=2002026.06 | 63 | 1.374 | |
| StandardNumber of Calibration Samples=5002026.06 | 61.6 | 1.411 | |
| AdaTSNumber of Calibration Samples=5002026.06 | 61.4 | 1.417 |