Conformal Prediction on Places365
90Coverage (alpha=0.1)APS
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| APSEnergy variant=w/o Energy, Backbone=ResNet-502026.02 | 90 | — | — | 7.56 | 95 | 14.28 | 97.5 | 24.92 | 99 | 46.81 | |
| Energy-based APSEnergy variant=w/ Energy, Backbone=ResNet-502026.02 | 90 | — | — | 7.11 | 95 | 12.98 | 97.5 | 22.32 | 99 | 40.73 | |
| RAPSEnergy variant=w/o Energy, Backbone=ResNet-502026.02 | 90 | — | — | 7.37 | 95 | 14.37 | 97.6 | 26.34 | 99 | 50.64 | |
| Energy-based RAPSEnergy variant=w/ Energy, Backbone=ResNet-502026.02 | 90 | — | — | 6.85 | 95 | 12.67 | 97.5 | 22.35 | 99 | 41.59 | |
| SAPSEnergy variant=w/o Energy, Backbone=ResNet-502026.02 | 90 | — | — | 7.2 | 95 | 14.11 | 97.6 | 25.76 | 99 | 49.8 | |
| Energy-based SAPSEnergy variant=w/ Energy, Backbone=ResNet-502026.02 | 90 | — | — | 6.79 | 95 | 12.51 | 97.5 | 22.19 | 99 | 41.19 | |
| Clustered Conformal PredictionScore=APS, n_avg=752023.06 | — | 2.7 | 11.6 | — | — | — | — | — | — | — | |
| Standard Conformal PredictionScore=softmax, n_avg=102023.06 | — | 4.5 | 6.9 | — | — | — | — | — | — | — |