Conformal Prediction on Camelyon (r* ≤ 0.33) 17 (test)
91.1CoverageRetrain
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RetrainNumber of Calibration Samples=20002026.06 | 91.1 | 1.21 | |
| ACP-MCNumber of Calibration Samples=20002026.06 | 89.7 | 1.321 | |
| RetrainNumber of Calibration Samples=10002026.06 | 89.3 | 1.348 | |
| RetrainNumber of Calibration Samples=5002026.06 | 88.8 | 1.358 | |
| ACP-ACCNumber of Calibration Samples=20002026.06 | 87.9 | 1.857 | |
| ACP-MCNumber of Calibration Samples=10002026.06 | 87 | 1.383 | |
| ACP-ACCNumber of Calibration Samples=10002026.06 | 86.1 | 1.854 | |
| RetrainNumber of Calibration Samples=2002026.06 | 85.8 | 1.257 | |
| ACP-AECNumber of Calibration Samples=20002026.06 | 85.8 | 1.835 | |
| ACP-ACCNumber of Calibration Samples=3002026.06 | 85.7 | 1.838 | |
| RetrainNumber of Calibration Samples=3002026.06 | 83.7 | 1.305 | |
| ACP-ACCNumber of Calibration Samples=5002026.06 | 83.7 | 1.822 | |
| ACP-MCNumber of Calibration Samples=5002026.06 | 78.8 | 1.494 | |
| ACP-MCNumber of Calibration Samples=3002026.06 | 76.3 | 1.61 | |
| ACP-AECNumber of Calibration Samples=10002026.06 | 74.8 | 1.721 | |
| ACP-ACCNumber of Calibration Samples=2002026.06 | 74.5 | 1.719 | |
| ACP-AECNumber of Calibration Samples=5002026.06 | 71.4 | 1.673 | |
| ACP-AECNumber of Calibration Samples=3002026.06 | 64.7 | 1.547 | |
| ACP-MCNumber of Calibration Samples=2002026.06 | 63.6 | 1.505 | |
| ACP-AECNumber of Calibration Samples=2002026.06 | 40.7 | 1.324 | |
| AdaTSNumber of Calibration Samples=3002026.06 | 36.2 | 1.224 | |
| AdaTSNumber of Calibration Samples=10002026.06 | 30.1 | 1.2 | |
| AdaTSNumber of Calibration Samples=20002026.06 | 28.9 | 1.171 | |
| StandardNumber of Calibration Samples=3002026.06 | 27.8 | 1.134 | |
| AdaTSNumber of Calibration Samples=5002026.06 | 27.1 | 1.183 | |
| AdaTSNumber of Calibration Samples=2002026.06 | 25 | 1.162 | |
| StandardNumber of Calibration Samples=20002026.06 | 24.1 | 1.127 | |
| StandardNumber of Calibration Samples=10002026.06 | 22.2 | 1.119 | |
| StandardNumber of Calibration Samples=5002026.06 | 19.7 | 1.098 | |
| StandardNumber of Calibration Samples=2002026.06 | 17.9 | 1.083 |