Image Classification on ImageNet 1% labels 1k (val)
76.6Top-1 AccuracySimCLRv2+KD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SimCLRv2+KDArch=RN152w3+SK, Param.=794M, Evaluation Protocol=Semi-supervised methods2021.04 | 76.6 | — | |
| BYOLArch=RN200w2, Param.=250M, Evaluation Protocol=Self-supervised pretraining with finetuning2021.04 | 71.2 | — | |
| DINOArch=ViT-S/16, Param.=21M, Evaluation Protocol=Frozen self-supervised features2021.04 | 64.5 | — | |
| SimCLRv2Arch=RN50w4, Param.=375M, Evaluation Protocol=Self-supervised pretraining with finetuning2021.04 | 63 | — | |
| SimCLRv2+KDArch=RN50, Param.=23M, Evaluation Protocol=Semi-supervised methods2021.04 | 60 | — | |
| SimCLRv2Arch=RN50, Param.=23M, Evaluation Protocol=Self-supervised pretraining with finetuning2021.04 | 57.9 | — | |
| MoCo-EMANArch=res50, Epochs=8002021.01 | 57.4 | 82.3 | |
| BYOL-EMANArch=res50, Epochs=2002021.01 | 55.1 | 78.9 | |
| SwAVArch=RN50, Param.=23M, Evaluation Protocol=Self-supervised pretraining with finetuning2021.04 | 53.9 | — | |
| SwAVArch=res50, Epochs=8002021.01 | 53.9 | 78.5 | |
| BYOLArch=RN50, Param.=23M, Evaluation Protocol=Self-supervised pretraining with finetuning2021.04 | 53.2 | — | |
| BYOLArch=res50, Epochs=10002021.01 | 53.2 | 78.4 | |
| CPC v2Arch=res1612021.01 | 52.7 | 77.9 | |
| MoCo-v2Arch=res50, Epochs=8002021.01 | 50.9 | 78.1 | |
| SimCLRArch=res50, Epochs=10002021.01 | 48.3 | 75.5 | |
| SupervisedArch=res50, Epochs=1002021.01 | 25.4 | 48.4 |