Conformal Prediction on MNIST (Coverage and Length)
99.4Coverage (alpha=0.025)CM
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CMCategory=Aggregation Method2025.12 | 99.4 | 96.1 | 97.7 | 96.7 | 1.125 | 0.975 | 1.009 | 0.988 | |
| CRCategory=Aggregation Method2025.12 | 98 | 96.2 | 94.4 | 92.6 | 1.013 | 0.975 | 0.952 | 0.931 | |
| LogisticCategory=Base Model2025.12 | 97.6 | 95.1 | 92.6 | 90.2 | 1.394 | 1.109 | 1.012 | 0.956 | |
| RandomForestCategory=Base Model2025.12 | 97.6 | 95.1 | 92.6 | 90.1 | 1.027 | 0.97 | 0.936 | 0.908 | |
| HistGBCategory=Base Model2025.12 | 97.5 | 95 | 92.5 | 90.1 | 0.996 | 0.958 | 0.929 | 0.903 | |
| MLPCategory=Base Model2025.12 | 97.5 | 95 | 92.7 | 90.8 | 0.997 | 0.958 | 0.932 | 0.912 | |
| BLCategory=Aggregation Method2025.12 | 97.5 | 95 | 92.5 | 90.1 | 0.996 | 0.958 | 0.929 | 0.903 | |
| SACPCategory=Aggregation Method2025.12 | 97.5 | 95.1 | 92.6 | 90.1 | 0.991 | 0.956 | 0.929 | 0.904 | |
| WaggCategory=Aggregation Method2025.12 | 97.4 | 95 | 92.5 | 90.1 | 0.986 | 0.955 | 0.928 | 0.903 | |
| CSACategory=Aggregation Method2025.12 | 97.4 | 95.2 | 92.6 | 90 | 0.99 | 0.958 | 0.93 | 0.903 | |
| SACP++Category=Aggregation Method2025.12 | 97.4 | 94.8 | 92.3 | 89.7 | 0.988 | 0.954 | 0.927 | 0.9 |