Conformal Prediction on Camelyon17 r* > 0.67 (test)
92.4CoverageStandard
Evaluation results
| Method | Links | ||
|---|---|---|---|
| StandardNumber of Calibration Samples=5002026.06 | 92.4 | 1.026 | |
| StandardNumber of Calibration Samples=10002026.06 | 92.3 | 1.026 | |
| StandardNumber of Calibration Samples=20002026.06 | 92.3 | 1.026 | |
| AdaTSNumber of Calibration Samples=10002026.06 | 92.2 | 1.055 | |
| AdaTSNumber of Calibration Samples=2002026.06 | 92.1 | 1.051 | |
| AdaTSNumber of Calibration Samples=5002026.06 | 92.1 | 1.054 | |
| AdaTSNumber of Calibration Samples=20002026.06 | 92 | 1.051 | |
| StandardNumber of Calibration Samples=3002026.06 | 91.9 | 1.02 | |
| ACP-ACCNumber of Calibration Samples=2002026.06 | 91.8 | 1.083 | |
| StandardNumber of Calibration Samples=2002026.06 | 91.7 | 1.016 | |
| AdaTSNumber of Calibration Samples=3002026.06 | 91.7 | 1.053 | |
| ACP-MCNumber of Calibration Samples=3002026.06 | 91.6 | 1.04 | |
| ACP-AECNumber of Calibration Samples=2002026.06 | 91.5 | 1.027 | |
| ACP-ACCNumber of Calibration Samples=3002026.06 | 91.4 | 1.065 | |
| ACP-AECNumber of Calibration Samples=3002026.06 | 91.4 | 1.025 | |
| ACP-MCNumber of Calibration Samples=2002026.06 | 91.1 | 1.048 | |
| ACP-ACCNumber of Calibration Samples=5002026.06 | 91.1 | 1.048 | |
| ACP-AECNumber of Calibration Samples=5002026.06 | 90.6 | 1.011 | |
| ACP-MCNumber of Calibration Samples=5002026.06 | 90.6 | 1.022 | |
| RetrainNumber of Calibration Samples=5002026.06 | 90.6 | 1.244 | |
| RetrainNumber of Calibration Samples=2002026.06 | 90.5 | 1.395 | |
| RetrainNumber of Calibration Samples=3002026.06 | 90.5 | 1.315 | |
| RetrainNumber of Calibration Samples=10002026.06 | 90.5 | 1.186 | |
| ACP-AECNumber of Calibration Samples=20002026.06 | 90.5 | 1.009 | |
| ACP-ACCNumber of Calibration Samples=20002026.06 | 90.4 | 1.023 | |
| RetrainNumber of Calibration Samples=20002026.06 | 90.4 | 1.122 | |
| ACP-AECNumber of Calibration Samples=10002026.06 | 90.3 | 1.006 | |
| ACP-MCNumber of Calibration Samples=10002026.06 | 90.3 | 1.005 | |
| ACP-ACCNumber of Calibration Samples=10002026.06 | 90.2 | 1.025 | |
| ACP-MCNumber of Calibration Samples=20002026.06 | 90.1 | 1.005 |