Conformal Prediction on Example 2 5-class data (a=0.5, Easy Bin, r* > 0.5) synthetic (test)
96.6CoverageStandard
Evaluation results
| Method | Links | ||
|---|---|---|---|
| StandardNumber of Calibration Samples=2002026.06 | 96.6 | 1.24 | |
| TrustscoreNumber of Calibration Samples=2002026.06 | 96.6 | 1.32 | |
| StandardNumber of Calibration Samples=5002026.06 | 96.6 | 1.231 | |
| StandardNumber of Calibration Samples=10002026.06 | 96.6 | 1.241 | |
| StandardNumber of Calibration Samples=50002026.06 | 96.6 | 1.259 | |
| StandardNumber of Calibration Samples=20002026.06 | 96.5 | 1.225 | |
| TrustscoreNumber of Calibration Samples=20002026.06 | 96.5 | 1.231 | |
| TrustscoreNumber of Calibration Samples=50002026.06 | 96.4 | 1.262 | |
| TrustscoreNumber of Calibration Samples=5002026.06 | 96.2 | 1.268 | |
| TrustscoreNumber of Calibration Samples=10002026.06 | 96.2 | 1.24 | |
| RetrainNumber of Calibration Samples=10002026.06 | 96 | 3.231 | |
| AdaTSNumber of Calibration Samples=2002026.06 | 95.9 | 1.359 | |
| TSNumber of Calibration Samples=2002026.06 | 95.9 | 1.343 | |
| TSNumber of Calibration Samples=10002026.06 | 95.9 | 1.351 | |
| TSNumber of Calibration Samples=50002026.06 | 95.9 | 1.363 | |
| AdaTSNumber of Calibration Samples=5002026.06 | 95.8 | 1.343 | |
| TSNumber of Calibration Samples=5002026.06 | 95.8 | 1.333 | |
| AdaTSNumber of Calibration Samples=10002026.06 | 95.8 | 1.356 | |
| TSNumber of Calibration Samples=20002026.06 | 95.8 | 1.319 | |
| AdaTSNumber of Calibration Samples=50002026.06 | 95.8 | 1.365 | |
| ACP-AECNumber of Calibration Samples=2002026.06 | 95.7 | 1.264 | |
| AdaTSNumber of Calibration Samples=20002026.06 | 95.6 | 1.325 | |
| ACP-AECNumber of Calibration Samples=5002026.06 | 95.2 | 1.232 | |
| ACP-AECNumber of Calibration Samples=10002026.06 | 95 | 1.226 | |
| RetrainNumber of Calibration Samples=20002026.06 | 94.8 | 2.881 | |
| ACP-MCNumber of Calibration Samples=2002026.06 | 94.6 | 1.576 | |
| ACP-ACCNumber of Calibration Samples=2002026.06 | 94.5 | 1.659 | |
| ACP-AECNumber of Calibration Samples=20002026.06 | 94.5 | 1.2 | |
| ACP-AECNumber of Calibration Samples=50002026.06 | 94.3 | 1.199 | |
| ACP-ACCNumber of Calibration Samples=5002026.06 | 94 | 1.386 | |
| ACP-ACCNumber of Calibration Samples=10002026.06 | 93.9 | 1.339 | |
| ACP-ACCNumber of Calibration Samples=20002026.06 | 93.7 | 1.276 | |
| ACP-MCNumber of Calibration Samples=5002026.06 | 93.4 | 1.547 | |
| ACP-ACCNumber of Calibration Samples=50002026.06 | 93.4 | 1.271 | |
| RetrainNumber of Calibration Samples=50002026.06 | 93.2 | 1.552 | |
| ACP-MCNumber of Calibration Samples=10002026.06 | 92.8 | 1.468 | |
| ACP-MCNumber of Calibration Samples=20002026.06 | 92.6 | 1.407 | |
| ACP-MCNumber of Calibration Samples=50002026.06 | 92.2 | 1.344 | |
| RetrainNumber of Calibration Samples=5002026.06 | 91.8 | 3.256 | |
| ACP-MC-OracleNumber of Calibration Samples=20002026.06 | 90.2 | 0.902 | |
| ACP-MC-OracleNumber of Calibration Samples=50002026.06 | 90.1 | 0.901 | |
| ACP-MC-OracleNumber of Calibration Samples=5002026.06 | 90 | 0.9 | |
| ACP-MC-OracleNumber of Calibration Samples=10002026.06 | 90 | 0.9 | |
| ACP-MC-OracleNumber of Calibration Samples=2002026.06 | 89.6 | 0.896 | |
| RetrainNumber of Calibration Samples=2002026.06 | 88.5 | 3.911 |