Conformal Prediction on Average across 15 datasets (test)
66.7Top-1 AccConf-OT
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Conf-OTBackbone=CLIP ViT-B/16, Non-conformity score=LAC2025.05 | 66.7 | 90 | 4.4 | 9.48 | 94.9 | 7.99 | 5.8 | |
| Conf-OTBackbone=CLIP ViT-B/16, Non-conformity score=APS2025.05 | 66.7 | 89.9 | 7.64 | 7.44 | 94.9 | 12.58 | 5.09 | |
| Conf-OTBackbone=CLIP ViT-B/16, Non-conformity score=RAPS2025.05 | 66.7 | 90 | 6.68 | 7.48 | 94.9 | 10.11 | 5.16 | |
| LACBackbone=CLIP ViT-B/162025.05 | 63.8 | 89.9 | 5.52 | 10.37 | 95 | 10.24 | 6.14 | |
| APSBackbone=CLIP ViT-B/162025.05 | 63.8 | 90 | 9.87 | 8.39 | 95 | 16.92 | 5.51 | |
| RAPSBackbone=CLIP ViT-B/162025.05 | 63.8 | 90 | 8.12 | 8.5 | 95 | 12.66 | 5.52 | |
| Conf-OTBackbone=CLIP ResNet-50, Non-conformity score=LAC2025.05 | 57.3 | 90 | 8.61 | 9.15 | 95.1 | 15.53 | 5.61 | |
| Conf-OTBackbone=CLIP ResNet-50, Non-conformity score=APS2025.05 | 57.3 | 90 | 12.94 | 7.64 | 95 | 20.96 | 5.03 | |
| Conf-OTBackbone=CLIP ResNet-50, Non-conformity score=RAPS2025.05 | 57.3 | 90 | 11.17 | 7.72 | 95 | 17.24 | 5.19 | |
| LACBackbone=CLIP ResNet-502025.05 | 54.7 | 90 | 10.77 | 9.82 | 95 | 19.22 | 5.91 | |
| APSBackbone=CLIP ResNet-502025.05 | 54.7 | 90 | 16.35 | 8.36 | 95 | 26.5 | 5.34 | |
| RAPSBackbone=CLIP ResNet-502025.05 | 54.7 | 90 | 13.37 | 8.46 | 95 | 22.06 | 5.44 |