Out-of-Distribution Detection on MOS benchmark
1.65FPR95 (iNaturalist)CMANegLabel
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| CMANegLabelProtocol=Multi-modal Fine-tuning (MMFT)2025.03 | 1.65 | 99.62 | 16.84 | 96.36 | 27.65 | 93.11 | 33.58 | 91.64 | 19.93 | 95.13 | |
| NegLabelProtocol=Zero-Shot (ZS)2025.03 | 2.3 | 99.37 | 23.23 | 95.14 | 39.85 | 90.98 | 46.49 | 89.64 | 27.97 | 93.78 | |
| m²-mixNegLabelProtocol=Multi-modal Fine-tuning (MMFT)2025.03 | 2.39 | 99.43 | 23.03 | 94.86 | 35.55 | 91.21 | 36.65 | 90.68 | 24.4 | 94.05 | |
| FLYPNegLabelProtocol=Multi-modal Fine-tuning (MMFT)2025.03 | 3.16 | 99.31 | 23.48 | 94.82 | 37.23 | 90.86 | 41.7 | 89.27 | 26.39 | 93.57 | |
| LoCoOpNegLabelProtocol=Prompt Learning (PL)2025.03 | 3.19 | 99.25 | 46.63 | 90.58 | 55.44 | 87.65 | 46.03 | 89.85 | 37.83 | 91.83 | |
| CoOpNegLabelProtocol=Prompt Learning (PL)2025.03 | 4.95 | 98.9 | 25.76 | 94.59 | 30.07 | 93.33 | 44.35 | 89.59 | 26.28 | 94.1 | |
| FFTODINProtocol=Single-modal Fine-tuning (SMFT)2025.03 | 19.05 | 96.38 | 39.24 | 90.75 | 46.93 | 88.52 | 52.89 | 85.93 | 39.53 | 90.4 | |
| m²-mixMCMProtocol=Multi-modal Fine-tuning (MMFT)2025.03 | 22.41 | 95.61 | 39.18 | 91.85 | 47.07 | 88.72 | 43.44 | 90.13 | 38.02 | 91.58 | |
| CMAMCMProtocol=Multi-modal Fine-tuning (MMFT)2025.03 | 22.95 | 95.65 | 40.01 | 91.78 | 48.83 | 88.41 | 44.93 | 89.87 | 39.18 | 91.43 | |
| LoCoOpMCMProtocol=Prompt Learning (PL)2025.03 | 23.08 | 95.46 | 33.39 | 93.25 | 40.74 | 90.52 | 40.75 | 91.14 | 34.49 | 92.59 | |
| CLIPNProtocol=Zero-Shot (ZS)2025.03 | 23.94 | 95.27 | 26.17 | 93.93 | 33.45 | 92.28 | 40.83 | 90.93 | 31.1 | 93.1 | |
| FFTEnergyProtocol=Single-modal Fine-tuning (SMFT)2025.03 | 24.46 | 95.62 | 58.98 | 84.77 | 59.92 | 83.89 | 55.6 | 84.45 | 49.74 | 87.18 | |
| FLYPMCMProtocol=Multi-modal Fine-tuning (MMFT)2025.03 | 24.86 | 94.35 | 39.81 | 90.58 | 47.92 | 87.16 | 41.19 | 89.34 | 38.44 | 90.36 | |
| CoOpMCMProtocol=Prompt Learning (PL)2025.03 | 26.37 | 94.49 | 35.23 | 92.59 | 43.29 | 89.67 | 41.47 | 90.62 | 36.59 | 91.84 | |
| LP-FTODINProtocol=Single-modal Fine-tuning (SMFT)2025.03 | 27.22 | 94.28 | 46.65 | 87.8 | 52.26 | 86 | 53.58 | 84.18 | 44.93 | 88.06 | |
| LPODINProtocol=Single-modal Fine-tuning (SMFT)2025.03 | 28.46 | 94.9 | 51.13 | 89.17 | 51.13 | 88.39 | 53.83 | 86.4 | 46.14 | 89.72 | |
| LP-FTEnergyProtocol=Single-modal Fine-tuning (SMFT)2025.03 | 29.16 | 93.93 | 48.27 | 87.47 | 53.24 | 85.68 | 54.57 | 83.81 | 46.31 | 87.72 | |
| LPEnergyProtocol=Single-modal Fine-tuning (SMFT)2025.03 | 31.09 | 94.48 | 58.42 | 86.95 | 65.9 | 83.68 | 75.48 | 78.23 | 57.72 | 85.83 | |
| MCMProtocol=Zero-Shot (ZS)2025.03 | 32.28 | 94.4 | 39.33 | 92.28 | 44.94 | 89.83 | 57.98 | 85.99 | 43.63 | 90.63 | |
| LPMSPProtocol=Single-modal Fine-tuning (SMFT)2025.03 | 41.61 | 90.87 | 67.03 | 81.07 | 66.03 | 81.25 | 62.82 | 81.46 | 59.37 | 83.66 | |
| LP-FTMSPProtocol=Single-modal Fine-tuning (SMFT)2025.03 | 44.02 | 89.81 | 66.6 | 80.78 | 69.2 | 80.06 | 65.59 | 79.44 | 61.35 | 82.52 | |
| FFTMSPProtocol=Single-modal Fine-tuning (SMFT)2025.03 | 51.66 | 87.87 | 70.55 | 79.86 | 71.77 | 79.42 | 70.82 | 78.42 | 66.2 | 81.39 |