Anomaly Segmentation on Fishyscapes Lost & Found (test)
0.81FPR@95PEBAL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PEBALBackbone=WideResnet38, Additional learnable parameters=false, Official code=false2021.11 | 0.81 | 78.29 | 99.76 | |
| Deep GamblerBackbone=WideResnet38, Additional learnable parameters=false, Official code=false2021.11 | 3.81 | 72.73 | 98.67 | |
| SynBoostBackbone=WideResnet38, Additional learnable parameters=true, Official code=true2021.11 | 4.89 | 70.43 | 98.38 | |
| FlowEneDetOE=false2022.11 | 5.2 | 50.2 | — | |
| Meta-OoDBackbone=WideResnet38, Additional learnable parameters=false, Official code=false2021.11 | 5.95 | 71.23 | 97.95 | |
| DenseHybridOoD Data=true, Extra Network=false2023.08 | 6.1 | 0.638 | — | |
| DenseHybridOE=true2022.11 | 6.2 | 43.9 | — | |
| RbAOoD Data=true, Extra Network=false2023.08 | 6.3 | 0.7081 | — | |
| PEBALOoD Data=true, Extra Network=false2023.08 | 6.56 | 0.6443 | — | |
| GMMSegOE=false2022.11 | 6.6 | 55.6 | — | |
| GMMSeg-DeepLabv3+Re-training=false, Extra Network=false, OoD Data=false2022.10 | 6.61 | 55.63 | — | |
| UGainSOoD Data=true, Extra Network=true2023.08 | 6.61 | 0.8008 | — | |
| RbA (re-implementation)OoD Data=true, Extra Network=false2023.08 | 7.46 | 0.7561 | — | |
| cDNP-Segmenter-BOE=true, backbone=Segmenter-ViT-B2022.11 | 7.5 | 69.8 | — | |
| PEBALOE=true2022.11 | 7.6 | 44.2 | — | |
| cDNP-Segmenter-BOE=false, backbone=Segmenter-ViT-B2022.11 | 8.8 | 62.2 | — | |
| NFlowJSOE=false2022.11 | 9 | 39.4 | — | |
| UGainSOoD Data=false, Extra Network=true2023.08 | 10.38 | 0.709 | — | |
| RbAOoD Data=false, Extra Network=false2023.08 | 10.63 | 0.6096 | — | |
| RbA (re-implementation)OoD Data=false, Extra Network=false2023.08 | 11.34 | 0.5951 | — | |
| GMMSegOoD Data=false, Extra Network=false2023.08 | 12.55 | 0.5003 | — | |
| CosMeUtilizing OOD Data=false, Requiring re-training=false2021.11 | 13.32 | 41.95 | — | |
| SMLOoD Data=false, Extra Network=false2023.08 | 14.53 | 0.3655 | — | |
| Max LogitBackbone=WideResnet38, Additional learnable parameters=false, Official code=false2021.11 | 15.56 | 65.45 | 94.52 | |
| EnergyBackbone=WideResnet38, Additional learnable parameters=false, Official code=false2021.11 | 15.69 | 66.37 | 94.45 | |
| SynboostUtilizing OOD Data=true, Requiring re-training=false2021.11 | 15.79 | 43.22 | — | |
| SynBoostRe-training=true, Extra Network=true, OoD Data=true2022.10 | 15.79 | 43.22 | — | |
| EntropyBackbone=WideResnet38, Additional learnable parameters=false, Official code=false2021.11 | 16.95 | 50.66 | 86.52 | |
| MSPBackbone=WideResnet38, Additional learnable parameters=false, Official code=false2021.11 | 18.56 | 38.2 | 85.49 | |
| Discriminative Outlier Detection HeadUtilizing OOD Data=true, Requiring re-training=true2021.11 | 19.02 | 31.31 | — | |
| Discriminative Outlier Detection HeadRe-training=true, Extra Network=true, OoD Data=true2022.10 | 19.02 | 31.31 | — | |
| SMLUtilizing OOD Data=false, Requiring re-training=false2021.11 | 21.52 | 31.05 | — | |
| SMLRe-training=false, Extra Network=false, OoD Data=false2022.10 | 21.52 | 31.05 | — | |
| OoD Training - Void ClassUtilizing OOD Data=true, Requiring re-training=true2021.11 | 22.11 | 10.29 | — | |
| OoD Training - Void ClassRe-training=true, Extra Network=true, OoD Data=true2022.10 | 22.11 | 10.29 | — | |
| Density - Logistic RegressionUtilizing OOD Data=true, Requiring re-training=true2021.11 | 24.36 | 4.65 | — | |
| Density - Logistic RegressionRe-training=true, Extra Network=true, OoD Data=false2022.10 | 24.36 | 4.65 | — | |
| MahalanobisBackbone=WideResnet38, Additional learnable parameters=false, Official code=false2021.11 | 24.51 | 42.56 | 79.53 | |
| kNN Embedding - densityUtilizing OOD Data=false, Requiring re-training=false2021.11 | 30.02 | 3.55 | — | |
| KNN Embedding - densityRe-training=false, Extra Network=false, OoD Data=false2022.10 | 30.02 | 3.55 | — | |
| MahalanobisOoD Data=false, Extra Network=false2023.08 | 30.17 | 0.2783 | — | |
| SynBoostOoD Data=true, Extra Network=true2023.08 | 31.02 | 0.6058 | — | |
| Density - Single-layer NLLUtilizing OOD Data=false, Requiring re-training=false2021.11 | 32.9 | 3.01 | — | |
| Density - Single-layer NLLRe-training=false, Extra Network=true, OoD Data=false2022.10 | 32.9 | 3.01 | — | |
| Maximized EntropyOoD Data=true, Extra Network=false2023.08 | 37.69 | 0.4131 | — | |
| Bayesian DeeplabUtilizing OOD Data=true, Requiring re-training=true2021.11 | 38.46 | 9.81 | — | |
| Bayesian DeeplabRe-training=false, Extra Network=true, OoD Data=false2022.10 | 38.46 | 9.81 | — | |
| M2F-EAMOE=false2022.11 | 41.3 | 9.4 | — | |
| SMLBackbone=WideResnet38, Additional learnable parameters=false, Official code=true2021.11 | 44.48 | 25.89 | 88.05 | |
| EntropyUtilizing OOD Data=false, Requiring re-training=false2021.11 | 44.83 | 2.93 | — | |
| EntropyRe-training=false, Extra Network=false, OoD Data=false2022.10 | 44.83 | 2.93 | — | |
| MSPUtilizing OOD Data=false, Requiring re-training=false2021.11 | 44.85 | 1.77 | — | |
| MSPRe-training=false, Extra Network=false, OoD Data=false2022.10 | 44.85 | 1.77 | — | |
| MSPOoD Data=false, Extra Network=false2023.08 | 45.63 | 0.0602 | — | |
| SynthCPOoD Data=false, Extra Network=true2023.08 | 45.95 | 0.0654 | — | |
| Density - Minimum NLLUtilizing OOD Data=false, Requiring re-training=false2021.11 | 47.15 | 4.25 | — | |
| Density - Minimum NLLRe-training=false, Extra Network=true, OoD Data=false2022.10 | 47.15 | 4.25 | — | |
| Dirichlet DeeplabUtilizing OOD Data=true, Requiring re-training=true2021.11 | 47.43 | 34.28 | — | |
| Dirichlet DeeplabRe-training=true, Extra Network=true, OoD Data=true2022.10 | 47.43 | 34.28 | — | |
| Image ResynthesisUtilizing OOD Data=false, Requiring re-training=false2021.11 | 48.05 | 5.7 | — | |
| Image ResynthesisRe-training=false, Extra Network=true, OoD Data=false2022.10 | 48.05 | 5.7 | — |