OOD Detection on Average
26.47FPR@95SCT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SCTBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=16-shot2024.11 | 26.47 | 93.37 | |
| LoCoOpBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=16-shot2024.11 | 29.47 | 93.1 | |
| SCTBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=1-shot2024.11 | 31.09 | 92.04 | |
| IDLikeBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=16-shot2024.11 | 32.12 | 92.14 | |
| IDLikeBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=1-shot2024.11 | 34.72 | 91.67 | |
| LoCoOpBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=1-shot2024.11 | 34.94 | 91.75 | |
| GL-MCMBackbone=CLIP-ViT-B/16, Setting=Zero-shot2024.11 | 35.06 | 90.9 | |
| CoOpBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=16-shot2024.11 | 35.09 | 91.99 | |
| NegPromptBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=16-shot2024.11 | 37.34 | 90.57 | |
| LSNBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=16-shot2024.11 | 39.58 | 91.53 | |
| RMDSBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 41.37 | 88.36 | |
| CoOpBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=1-shot2024.11 | 42.38 | 90.72 | |
| MCMBackbone=CLIP-ViT-B/16, Setting=Zero-shot2024.11 | 42.61 | 90.66 | |
| MDSBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 42.74 | 86.92 | |
| OursBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 43.99 | 86.03 | |
| GENBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 45.15 | 86.19 | |
| KNNBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 46.28 | 82.45 | |
| LSNBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=1-shot2024.11 | 46.47 | 87.84 | |
| MSPBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 52.27 | 84.47 | |
| MaxLogitBackbone=CLIP-ViT-B/16, Setting=Post-hoc2024.11 | 52.49 | 88.82 | |
| ReActBackbone=CLIP-ViT-B/16, Setting=Post-hoc2024.11 | 54.62 | 88.37 | |
| EnergyBackbone=CLIP-ViT-B/16, Setting=Post-hoc2024.11 | 54.8 | 88.48 | |
| ReActBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 56.3 | 83.69 | |
| SHEBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 58 | 84.63 | |
| TempScaleBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 59.03 | 82.83 | |
| NegPromptBackbone=CLIP-ViT-B/16, Setting=Prompt tuning, Shots=1-shot2024.11 | 62.08 | 81.13 | |
| OpenMaxBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 63.06 | 83.96 | |
| MSPBackbone=CLIP-ViT-B/16, Setting=Post-hoc2024.11 | 74.98 | 76.22 | |
| ODINBackbone=CLIP-ViT-B/16, Setting=Post-hoc2024.11 | 90.23 | 71.13 | |
| ASHBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 94.71 | 45.26 | |
| GradNormBackbone=Swin Transformer, In-Distribution Accuracy=81.60%2026.04 | 95.45 | 40.49 |