Conformal Prediction on 5-class synthetic data Marginal
92.3CoverageACP-AEC
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ACP-AECNumber of Calibration Samples=20002026.06 | 92.3 | 1.895 | |
| ACP-AECNumber of Calibration Samples=50002026.06 | 92.2 | 1.827 | |
| ACP-ACCNumber of Calibration Samples=20002026.06 | 92 | 1.906 | |
| ACP-ACCNumber of Calibration Samples=50002026.06 | 92 | 1.854 | |
| ACP-ACCNumber of Calibration Samples=5002026.06 | 91.9 | 1.968 | |
| ACP-ACCNumber of Calibration Samples=10002026.06 | 91.8 | 1.937 | |
| ACP-ACCNumber of Calibration Samples=2002026.06 | 91.7 | 2.215 | |
| ACP-AECNumber of Calibration Samples=10002026.06 | 91.4 | 1.804 | |
| ACP-MCNumber of Calibration Samples=2002026.06 | 90.3 | 1.914 | |
| AdaTSNumber of Calibration Samples=2002026.06 | 90.3 | 1.57 | |
| ACP-AECNumber of Calibration Samples=2002026.06 | 90.2 | 1.537 | |
| ACP-AECNumber of Calibration Samples=5002026.06 | 90.2 | 1.563 | |
| ACP-MCNumber of Calibration Samples=20002026.06 | 90.2 | 1.754 | |
| ACP-MCNumber of Calibration Samples=10002026.06 | 90.1 | 1.764 | |
| RetrainNumber of Calibration Samples=20002026.06 | 90.1 | 2.258 | |
| RetrainNumber of Calibration Samples=50002026.06 | 90.1 | 1.736 | |
| AdaTSNumber of Calibration Samples=20002026.06 | 90 | 1.445 | |
| StandardNumber of Calibration Samples=20002026.06 | 90 | 1.208 | |
| ACP-MCNumber of Calibration Samples=50002026.06 | 90 | 1.705 | |
| AdaTSNumber of Calibration Samples=5002026.06 | 89.9 | 1.477 | |
| StandardNumber of Calibration Samples=50002026.06 | 89.9 | 1.206 | |
| ACP-MCNumber of Calibration Samples=5002026.06 | 89.8 | 1.791 | |
| AdaTSNumber of Calibration Samples=50002026.06 | 89.8 | 1.437 | |
| StandardNumber of Calibration Samples=5002026.06 | 89.7 | 1.21 | |
| StandardNumber of Calibration Samples=10002026.06 | 89.7 | 1.194 | |
| AdaTSNumber of Calibration Samples=10002026.06 | 89.6 | 1.41 | |
| RetrainNumber of Calibration Samples=10002026.06 | 89.5 | 2.418 | |
| StandardNumber of Calibration Samples=2002026.06 | 89.4 | 1.243 | |
| RetrainNumber of Calibration Samples=5002026.06 | 89.4 | 2.641 | |
| RetrainNumber of Calibration Samples=2002026.06 | 88.8 | 3.779 |