Conformal Prediction (RAPS nonconformity score) on SICAPv2 (test)
0.671ACAAdapt+SCP
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Adapt+SCPGroup=Labeled-Cal., Calibration Shots=162026.02 | 0.671 | 0.856 | 2.55 | 8.64 | 0.923 | 3.17 | 6.12 | |
| FCAGroup=Labeled-Cal., Calibration Shots=162026.02 | 0.671 | 0.898 | 3.05 | 6.21 | 0.951 | 3.66 | 4.23 | |
| LATA-LIGroup=UT, Calibration Shots=16, Beta=0.22026.02 | 0.568 | 0.913 | 3.36 | 6.75 | 0.962 | 4.1 | 4.22 | |
| LATA-LFGroup=UT, Calibration Shots=16, Beta=02026.02 | 0.564 | 0.903 | 3.29 | 6.85 | 0.954 | 4.02 | 4.25 | |
| SCA-TGroup=UT, Calibration Shots=162026.02 | 0.552 | 0.903 | 3.4 | 7.5 | 0.954 | 4.18 | 4.57 | |
| Conf-OTGroup=UT, Calibration Shots=162026.02 | 0.531 | 0.899 | 3.42 | 8.53 | 0.95 | 4.09 | 5.21 | |
| SCPGroup=Baseline, Calibration Shots=162026.02 | 0.502 | 0.901 | 4.16 | 9.55 | 0.952 | 5.12 | 5.57 |