Selective Classification on ImageNet 1K
1.04NAURCSIRC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SIRCBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 1.04 | — | 16.3 | |
| EnergyBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.901 | — | 14.2 | |
| MDSBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.699 | — | 11.3 | |
| KNNBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.643 | — | 10.5 | |
| EnergyBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.59 | 6.82 | — | |
| EnergyBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.573 | 9.89 | — | |
| MSPBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.542 | — | 9.08 | |
| MaxLogitBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.542 | — | 9.08 | |
| MaxLogitBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.372 | 6.99 | — | |
| MaxLogitBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.371 | 4.53 | — | |
| MDSBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.322 | 4.01 | — | |
| KNNBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.321 | 4 | — | |
| SIRCBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.295 | 5.87 | — | |
| SIRCBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.29 | 3.68 | — | |
| MDSBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.284 | 5.6 | — | |
| KNNBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.282 | 5.56 | — | |
| MSPBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.264 | 5.43 | — | |
| Δ-MDSBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.257 | — | 5 | |
| MSPBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.256 | 3.32 | — | |
| RLogBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.246 | — | 4.83 | |
| Δ-KNNBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.23 | — | 4.6 | |
| Δ-MDS-RLogBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.197 | — | 4.13 | |
| Δ-KNNBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.188 | 4.31 | — | |
| Δ-KNNBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.187 | 2.6 | — | |
| Δ-KNN-RLogBackbone=DFN CLIP, Evaluation=Zero-shot, Selector score=Post-hoc2025.05 | 0.187 | — | 3.98 | |
| Δ-MDSBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.183 | 2.56 | — | |
| Δ-MDSBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.18 | 4.18 | — | |
| RLogBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.172 | 4.11 | — | |
| Δ-KNN-RLogBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.166 | 4 | — | |
| RLogBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.161 | 2.33 | — | |
| Δ-KNN-RLogBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.159 | 2.31 | — | |
| Δ-MDS-RLogBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.157 | 3.86 | — | |
| Δ-MDS-RLogBackbone=EVA, Protocol=Supervised learning, Coverage=Full2025.05 | 0.155 | 2.26 | — |