Conformal Prediction on FashionMNIST (test)
3.2814Efficiency Rate (γn,m)SCP
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SCPn (transductive size)=9, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 3.2814 | 3.3219 | 0.96 | |
| APSn (transductive size)=9, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 3.2051 | 3.2108 | 0.94 | |
| SCPn (transductive size)=6, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 3.1786 | 3.1289 | 0.9 | |
| APSn (transductive size)=6, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 3.1481 | 3.1553 | 0.94 | |
| SCPn (transductive size)=3, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 2.9737 | 2.9053 | 0.92 | |
| APSn (transductive size)=3, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 2.9325 | 2.8765 | 0.94 | |
| SCPTransductive size (n)=9, Alpha=0.1, Noise level (1-epsilon)=1, Backbone=ResNet202025.09 | 2.8065 | 0.5744 | 0.98 | |
| APSTransductive size (n)=9, Alpha=0.1, Noise level (1-epsilon)=1, Backbone=ResNet202025.09 | 2.5844 | 0.4633 | 0.94 | |
| SCPTransductive size (n)=9, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 2.3624 | 0.5094 | 84 | |
| TSCPn (transductive size)=6, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 2.1825 | 1.8881 | 0.92 | |
| TSCPn (transductive size)=9, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 2.0811 | 1.8127 | 0.86 | |
| APSTransductive size (n)=9, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 1.9871 | 0.7505 | 74 | |
| TSCPn (transductive size)=3, alpha=0.1, noise level (1-epsilon)=0.9, Backbone=ResNet202025.09 | 1.857 | 1.774 | 0.86 | |
| SCPTransductive size (n)=6, Alpha=0.1, Noise level (1-epsilon)=1, Backbone=ResNet202025.09 | 1.4176 | 0.4308 | 0.94 | |
| APSTransductive size (n)=6, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 1.4049 | 0.1667 | 66 | |
| APSTransductive size (n)=6, Alpha=0.1, Noise level (1-epsilon)=1, Backbone=ResNet202025.09 | 1.3496 | 0.3333 | 0.98 | |
| SCPTransductive size (n)=6, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.8103 | 0.1667 | 80 | |
| TSCPTransductive size (n)=9, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.6251 | 0.3915 | 72 | |
| TSCPTransductive size (n)=9, Alpha=0.1, Noise level (1-epsilon)=1, Backbone=ResNet202025.09 | 0.6031 | 0.4542 | 0.9 | |
| TSCPTransductive size (n)=6, Alpha=0.1, Noise level (1-epsilon)=1, Backbone=ResNet202025.09 | 0.5478 | 0.2642 | 0.98 | |
| APSTransductive size (n)=3, Alpha=0.1, Noise level (1-epsilon)=1, Backbone=ResNet202025.09 | 0.2608 | 0 | 0.84 | |
| TSCPTransductive size (n)=6, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.2593 | 0 | 64 | |
| SCPTransductive size (n)=3, Alpha=0.1, Noise level (1-epsilon)=1, Backbone=ResNet202025.09 | 0.1754 | 0 | 0.84 | |
| TSCPTransductive size (n)=3, Alpha=0.1, Noise level (1-epsilon)=1, Backbone=ResNet202025.09 | 0.1111 | 0 | 0.84 | |
| APSTransductive size (n)=3, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | 0.0877 | 0 | 66 | |
| SCPTransductive size (n)=3, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | -0.0507 | 0 | 70 | |
| TSCPTransductive size (n)=3, α=0.3, Noise level (1-ϵ)=0.98, Backbone=ResNet202025.09 | -0.0725 | 0 | 76 |