Open-set Recognition on CIFAR10 (6 closed, 4 open classes)
0.997AUROCOpenMatch
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OpenMatchNo. of labeled samples=1002021.05 | 0.997 | — | — | |
| OpenMatchNo. of labeled samples=502021.05 | 0.993 | — | — | |
| OpenMatchNo. of labeled samples=4002021.05 | 0.993 | — | — | |
| MTCNo. of labeled samples=4002021.05 | 0.989 | — | — | |
| MTCNo. of labeled samples=1002021.05 | 0.982 | — | — | |
| LMCExtra training process=Not involved2023.09 | 0.966 | — | — | |
| MTCNo. of labeled samples=502021.05 | 0.966 | — | — | |
| PMALVenue=AAAI 2022, Extra training process=Involved2023.09 | 0.951 | — | — | |
| OpenHybridVenue=ECCV 2020, Extra training process=Involved2023.09 | 0.95 | — | — | |
| Class-inclusionVenue=ECCV 2022, Extra training process=Involved2023.09 | 0.948 | — | — | |
| SoftmaxExtra training process=Not involved2023.09 | 0.937 | — | — | |
| MLSVenue=ICLR 2022, Extra training process=Involved2023.09 | 0.936 | — | — | |
| ZOCVenue=AAAI 2022, Extra training process=Involved2023.09 | 0.93 | — | — | |
| RCSSRVenue=TPAMI 2022, Extra training process=Involved2023.09 | 0.915 | — | — | |
| CSSRVenue=TPAMI 2022, Extra training process=Involved2023.09 | 0.913 | — | — | |
| ARPL+CSVenue=TPAMI 2021, Extra training process=Involved2023.09 | 0.91 | — | — | |
| RPLVenue=ECCV 2020, Extra training process=Involved2023.09 | 0.901 | — | — | |
| ARPLVenue=TPAMI 2021, Extra training process=Involved2023.09 | 0.901 | — | — | |
| C2AEVenue=CVPR 2019, Extra training process=Involved2023.09 | 0.895 | — | — | |
| ODL+Venue=TPAMI 2022, Extra training process=Involved2023.09 | 0.885 | — | — | |
| ODLVenue=TPAMI 2022, Extra training process=Involved2023.09 | 0.857 | — | — | |
| DIASVenue=ECCV 2022, Extra training process=Involved2023.09 | 0.85 | — | — | |
| CVAECapOSRVenue=ICCV 2021, Extra training process=Involved2023.09 | 0.835 | — | — | |
| Labeled OnlyNo. of labeled samples=4002021.05 | 0.768 | — | — | |
| FixMatchNo. of labeled samples=4002021.05 | 0.718 | — | — | |
| OSRCIVenue=ECCV 2018, Extra training process=Involved2023.09 | 0.699 | — | — | |
| Labeled OnlyNo. of labeled samples=1002021.05 | 0.647 | — | — | |
| Labeled OnlyNo. of labeled samples=502021.05 | 0.639 | — | — | |
| FixMatchNo. of labeled samples=1002021.05 | 0.604 | — | — | |
| FixMatchNo. of labeled samples=502021.05 | 0.561 | — | — | |
| ARPLVenue=TPAMI 2021, Involves extra training=true2023.09 | — | 0.866 | — | |
| ARPL+CSVenue=TPAMI 2021, Involves extra training=true2023.09 | — | 0.879 | — | |
| DACNo. of labeled samples=5, Backbone=WideResNet-28-22026.06 | — | — | 0.7202 | |
| DACNo. of labeled samples=10, Backbone=WideResNet-28-22026.06 | — | — | 0.7626 | |
| DACNo. of labeled samples=25, Backbone=WideResNet-28-22026.06 | — | — | 0.7748 | |
| DAC + GGRNo. of labeled samples=5, Backbone=WideResNet-28-22026.06 | — | — | 0.7372 | |
| DAC + GGRNo. of labeled samples=10, Backbone=WideResNet-28-22026.06 | — | — | 0.7719 | |
| DAC + GGRNo. of labeled samples=25, Backbone=WideResNet-28-22026.06 | — | — | 0.7866 | |
| GCPLVenue=CVPR 2018, Involves extra training=true2023.09 | — | 0.843 | — | |
| IOMatchNo. of labeled samples=5, Backbone=WideResNet-28-22026.06 | — | — | 0.725 | |
| IOMatchNo. of labeled samples=10, Backbone=WideResNet-28-22026.06 | — | — | 0.7411 | |
| IOMatchNo. of labeled samples=25, Backbone=WideResNet-28-22026.06 | — | — | 0.7683 | |
| IOMatch + GGRNo. of labeled samples=5, Backbone=WideResNet-28-22026.06 | — | — | 0.7413 | |
| IOMatch + GGRNo. of labeled samples=10, Backbone=WideResNet-28-22026.06 | — | — | 0.7558 | |
| IOMatch + GGRNo. of labeled samples=25, Backbone=WideResNet-28-22026.06 | — | — | 0.7686 | |
| LMCInvolves extra training=false2023.09 | — | 0.936 | — | |
| ODLVenue=TPAMI 2022, Involves extra training=true2023.09 | — | 0.848 | — | |
| ODL+Venue=TPAMI 2022, Involves extra training=true2023.09 | — | 0.869 | — | |
| RPLVenue=ECCV 2020, Involves extra training=true2023.09 | — | 0.852 | — | |
| SoftmaxInvolves extra training=false2023.09 | — | 0.901 | — |