Conformal Prediction on SICAP v2 (test)
67.1ACAAdapt+SCP
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Adapt+SCPGroup=Labeled-Cal., Calibration Shots=162026.02 | 67.1 | 84.2 | 2.4 | 11.17 | 92.1 | 3.07 | 6.87 | |
| FCAGroup=Labeled-Cal., Calibration Shots=162026.02 | 67.1 | 89.6 | 2.91 | 8.38 | 95.2 | 3.56 | 5.02 | |
| LATA-LIGroup=UT, Calibration Shots=16, Beta=0.22026.02 | 57.4 | 91 | 3.15 | 6.25 | 96.2 | 3.86 | 3.4 | |
| LATA-LFGroup=UT, Calibration Shots=16, Beta=02026.02 | 57 | 90 | 3.07 | 6.4 | 95.2 | 3.76 | 3.35 | |
| SCA-TGroup=UT, Calibration Shots=162026.02 | 55.2 | 89.8 | 3.3 | 7.47 | 95.2 | 4.03 | 4.03 | |
| Conf-OTGroup=UT, Calibration Shots=162026.02 | 53.1 | 89.9 | 3.18 | 9.07 | 95 | 3.81 | 5.34 | |
| SCPGroup=Baseline, Calibration Shots=162026.02 | 50.2 | 89 | 3.99 | 9.96 | 95.1 | 4.88 | 5.68 |