Conformal Prediction on CIFAR10 (test)
0Median Prediction Set SizeSCP
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SCPTransductive size (n)=3, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0 | 0.2773 | 80 | — | |
| TSCPTransductive size (n)=3, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0 | 0.2495 | 58 | — | |
| TSCPn (transductive size)=3, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 0.1659 | — | 86 | 1.9206 | |
| TSCPn (transductive size)=6, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 0.1836 | — | 90 | 1.9853 | |
| TSCPn (transductive size)=9, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 0.1878 | — | 92 | 2.0876 | |
| SCPn (transductive size)=3, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 0.2824 | — | 92 | 2.9025 | |
| APSn (transductive size)=3, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 0.2912 | — | 92 | 2.9224 | |
| APSn (transductive size)=6, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 0.3119 | — | 96 | 3.1277 | |
| SCPn (transductive size)=6, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 0.3152 | — | 88 | 3.1617 | |
| SCPn (transductive size)=9, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 0.3162 | — | 84 | 3.1944 | |
| APSn (transductive size)=9, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 0.3183 | — | 90 | 3.1917 | |
| APSTransductive size (n)=3, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.3333 | 0.652 | 82 | — | |
| TSCPTransductive size (n)=6, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.4845 | 0.5267 | 70 | — | |
| SCPTransductive size (n)=6, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.5975 | 0.7715 | 62 | — | |
| TSCPTransductive size (n)=9, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.6271 | 0.7584 | 74 | — | |
| APSTransductive size (n)=6, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.7486 | 1.4566 | 74 | — | |
| SCPTransductive size (n)=9, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.9588 | 1.8287 | 82 | — | |
| APSTransductive size (n)=9, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.9624 | 2.2617 | 74 | — |