Far Out-of-Distribution Detection on iNaturalist
5.76FPR95KgCoOp
Evaluation results
| Method | Links | ||
|---|---|---|---|
| KgCoOpScoring Function=MaxLogit, Variant=CLS-M2024.05 | 5.76 | -9 | |
| KgCoOpScoring Function=MaxLogit, Evaluation Variant=CLS-M, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 5.76 | -9 | |
| LoCoOpScoring Function=MaxLogit, Variant=CLS-M2024.05 | 6.17 | -44.92 | |
| LoCoOpScoring Function=MaxLogit, Evaluation Variant=CLS-M, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 6.17 | -44.92 | |
| KgCoOpScoring Function=Energy, Variant=CLS-E2024.05 | 8.6 | -16.9 | |
| KgCoOpScoring Function=Energy, Evaluation Variant=CLS-E, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 8.6 | -16.9 | |
| IVLPScoring Function=MaxLogit, Variant=CLS-M2024.05 | 8.85 | -13.66 | |
| IVLPScoring Function=MaxLogit, Evaluation Variant=CLS-M, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 8.85 | -13.66 | |
| CoCoOpScoring Function=MaxLogit, Variant=CLS-M2024.05 | 9.68 | -4.35 | |
| CoCoOpScoring Function=MaxLogit, Evaluation Variant=CLS-M, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 9.68 | -4.35 | |
| MaPLeScoring Function=MaxLogit, Variant=CLS-M2024.05 | 10.38 | -13.58 | |
| MaPLeScoring Function=MaxLogit, Evaluation Variant=CLS-M, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 10.38 | -13.58 | |
| CoOpScoring Function=MaxLogit, Variant=CLS-M2024.05 | 13.64 | -19.07 | |
| CoOpScoring Function=MaxLogit, Evaluation Variant=CLS-M, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 13.64 | -19.07 | |
| CoCoOpScoring Function=MaxLogit, Variant=Original2024.05 | 14.03 | — | |
| CoCoOpScoring Function=MaxLogit, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 14.03 | — | |
| KgCoOpScoring Function=MaxLogit, Variant=Original2024.05 | 14.76 | — | |
| KgCoOpScoring Function=MaxLogit, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 14.76 | — | |
| IVLPScoring Function=Energy, Variant=CLS-E2024.05 | 15.17 | -24.33 | |
| IVLPScoring Function=Energy, Evaluation Variant=CLS-E, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 15.17 | -24.33 | |
| PromptSRCScoring Function=MaxLogit, Variant=CLS-M2024.05 | 16.03 | -3.35 | |
| PromptSRCScoring Function=MaxLogit, Evaluation Variant=CLS-M, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 16.03 | -3.35 | |
| CoCoOpScoring Function=Energy, Variant=CLS-E2024.05 | 16.71 | -8.04 | |
| CoCoOpScoring Function=Energy, Evaluation Variant=CLS-E, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 16.71 | -8.04 | |
| LoCoOpScoring Function=Energy, Variant=CLS-E2024.05 | 18.46 | -67.51 | |
| LoCoOpScoring Function=Energy, Evaluation Variant=CLS-E, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 18.46 | -67.51 | |
| PromptSRCScoring Function=MaxLogit, Variant=Original2024.05 | 19.38 | — | |
| PromptSRCScoring Function=MaxLogit, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 19.38 | — | |
| MaPLeScoring Function=Energy, Variant=CLS-E2024.05 | 19.62 | -22.62 | |
| MaPLeScoring Function=Energy, Evaluation Variant=CLS-E, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 19.62 | -22.62 | |
| CoOpScoring Function=Energy, Variant=CLS-E2024.05 | 20.24 | -27.93 | |
| CoOpScoring Function=Energy, Evaluation Variant=CLS-E, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 20.24 | -27.93 | |
| ProGradScoring Function=MaxLogit, Variant=CLS-M2024.05 | 21.29 | -22.42 | |
| ProGradScoring Function=MaxLogit, Evaluation Variant=CLS-M, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 21.29 | -22.42 | |
| IVLPScoring Function=MaxLogit, Variant=Original2024.05 | 22.51 | — | |
| IVLPScoring Function=MaxLogit, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 22.51 | — | |
| MaPLeScoring Function=MaxLogit, Variant=Original2024.05 | 23.97 | — | |
| MaPLeScoring Function=MaxLogit, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 23.97 | — | |
| CoCoOpScoring Function=Energy, Variant=Original2024.05 | 24.75 | — | |
| CoCoOpScoring Function=Energy, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 24.75 | — | |
| KgCoOpScoring Function=Energy, Variant=Original2024.05 | 25.5 | — | |
| KgCoOpScoring Function=Energy, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 25.5 | — | |
| PromptSRCScoring Function=Energy, Variant=CLS-E2024.05 | 29.98 | -3.67 | |
| PromptSRCScoring Function=Energy, Evaluation Variant=CLS-E, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 29.98 | -3.67 | |
| ProGradScoring Function=Energy, Variant=CLS-E2024.05 | 32.44 | -25.9 | |
| ProGradScoring Function=Energy, Evaluation Variant=CLS-E, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 32.44 | -25.9 | |
| CoOpScoring Function=MaxLogit, Variant=Original2024.05 | 32.7 | — | |
| CoOpScoring Function=MaxLogit, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 32.7 | — | |
| PromptSRCScoring Function=Energy, Variant=Original2024.05 | 33.65 | — | |
| PromptSRCScoring Function=Energy, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 33.65 | — | |
| IVLPScoring Function=Energy, Variant=Original2024.05 | 39.5 | — | |
| IVLPScoring Function=Energy, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 39.5 | — | |
| MaPLeScoring Function=Energy, Variant=Original2024.05 | 42.23 | — | |
| MaPLeScoring Function=Energy, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 42.23 | — | |
| ProGradScoring Function=MaxLogit, Variant=Original2024.05 | 43.71 | — | |
| ProGradScoring Function=MaxLogit, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 43.71 | — | |
| CoOpScoring Function=Energy, Variant=Original2024.05 | 48.16 | — | |
| CoOpScoring Function=Energy, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 48.16 | — | |
| LoCoOpScoring Function=MaxLogit, Variant=Original2024.05 | 51.09 | — | |
| LoCoOpScoring Function=MaxLogit, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 51.09 | — | |
| ProGradScoring Function=Energy, Variant=Original2024.05 | 58.34 | — | |
| ProGradScoring Function=Energy, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 58.34 | — | |
| LoCoOpScoring Function=Energy, Variant=Original2024.05 | 85.97 | — | |
| LoCoOpScoring Function=Energy, Evaluation Variant=Original, Few-shot settings=averaged (16, 8, 4, 2, 1)2024.05 | 85.97 | — |