Conformal Prediction (APS nonconformity score) on SICAP v2 (test)
67.1ACAAdapt+SCP
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Adapt+SCPGroup=Labeled-Cal., Calibration Shots=162026.02 | 67.1 | 85.8 | 2.56 | 8.57 | 92.4 | 3.19 | 6.08 | |
| FCAGroup=Labeled-Cal., Calibration Shots=162026.02 | 67.1 | 89.8 | 3.06 | 6.12 | 94.9 | 3.67 | 4.24 | |
| LATA-LIGroup=UT, Calibration Shots=16, Beta=0.22026.02 | 57.5 | 91 | 3.03 | 6.25 | 96.3 | 3.88 | 3.45 | |
| LATA-LFGroup=UT, Calibration Shots=16, Beta=02026.02 | 57.1 | 90 | 2.95 | 6.32 | 95.4 | 3.78 | 3.55 | |
| SCA-TGroup=UT, Calibration Shots=162026.02 | 55.2 | 90 | 3.35 | 7.18 | 95.4 | 4.08 | 3.97 | |
| Conf-OTGroup=UT, Calibration Shots=162026.02 | 53.1 | 89.9 | 3.13 | 8.64 | 95 | 3.63 | 5.12 | |
| SCPGroup=Baseline, Calibration Shots=162026.02 | 50.2 | 90 | 4.05 | 9.59 | 95.2 | 4.88 | 5.54 |