Conformal Prediction on 5-class synthetic data Hard Bin, r* <= 0.5
92.8CoverageACP-ACC
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ACP-ACCNumber of Calibration Samples=20002026.06 | 92.8 | 4.498 | |
| ACP-AECNumber of Calibration Samples=20002026.06 | 91.7 | 4.598 | |
| ACP-AECNumber of Calibration Samples=50002026.06 | 91.3 | 4.59 | |
| ACP-ACCNumber of Calibration Samples=50002026.06 | 90.7 | 4.413 | |
| ACP-ACCNumber of Calibration Samples=10002026.06 | 90.2 | 4.324 | |
| ACP-MCNumber of Calibration Samples=50002026.06 | 87 | 4.014 | |
| ACP-MCNumber of Calibration Samples=20002026.06 | 86.8 | 3.996 | |
| ACP-ACCNumber of Calibration Samples=5002026.06 | 84.9 | 3.938 | |
| ACP-AECNumber of Calibration Samples=10002026.06 | 84.8 | 4.173 | |
| ACP-MCNumber of Calibration Samples=10002026.06 | 84 | 3.871 | |
| RetrainNumber of Calibration Samples=2002026.06 | 81.1 | 3.8 | |
| ACP-MCNumber of Calibration Samples=5002026.06 | 77.7 | 3.547 | |
| ACP-ACCNumber of Calibration Samples=2002026.06 | 74.1 | 3.447 | |
| RetrainNumber of Calibration Samples=50002026.06 | 73.2 | 2.745 | |
| RetrainNumber of Calibration Samples=5002026.06 | 70 | 2.701 | |
| RetrainNumber of Calibration Samples=20002026.06 | 69.7 | 2.71 | |
| ACP-AECNumber of Calibration Samples=5002026.06 | 68.7 | 3.137 | |
| RetrainNumber of Calibration Samples=10002026.06 | 67.6 | 2.605 | |
| ACP-MCNumber of Calibration Samples=2002026.06 | 66.8 | 3.068 | |
| ACP-AECNumber of Calibration Samples=2002026.06 | 56.2 | 2.224 | |
| AdaTSNumber of Calibration Samples=2002026.06 | 48.4 | 1.655 | |
| StandardNumber of Calibration Samples=20002026.06 | 46.5 | 1.441 | |
| StandardNumber of Calibration Samples=50002026.06 | 46.1 | 1.437 | |
| AdaTSNumber of Calibration Samples=20002026.06 | 45.5 | 1.533 | |
| AdaTSNumber of Calibration Samples=5002026.06 | 45.4 | 1.559 | |
| StandardNumber of Calibration Samples=2002026.06 | 45.1 | 1.449 | |
| StandardNumber of Calibration Samples=5002026.06 | 44.9 | 1.427 | |
| StandardNumber of Calibration Samples=10002026.06 | 44.8 | 1.417 | |
| AdaTSNumber of Calibration Samples=50002026.06 | 44.6 | 1.526 | |
| AdaTSNumber of Calibration Samples=10002026.06 | 43.3 | 1.505 |