Clustering on CIFAR20 small-scale (val)
85.7NMIProbing CLIP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Probing CLIPBackbone=ViT-L/14, Evaluation protocol=Supervised Probing2023.03 | 85.7 | 91.7 | 83.6 | |
| Probing Sup.Backbone=ViT-L/16, Evaluation protocol=Supervised Probing2023.03 | 83.7 | 90.8 | 81.7 | |
| Probing DINOBackbone=ViT-B/16, Evaluation protocol=Supervised Probing2023.03 | 82.4 | 89.5 | 79.5 | |
| Probing MSNBackbone=ViT-L/16, Evaluation protocol=Supervised Probing2023.03 | 80.7 | 88.2 | 77 | |
| TEMIPre-training type=DINO, Backbone=ViT-B/16, Evaluation protocol=Clustering2023.03 | 65.4 | 63.2 | 48.9 | |
| TEMIPre-training type=supervised, Backbone=ViT-L/16, Evaluation protocol=Clustering2023.03 | 65 | 58.4 | 45.4 | |
| TEMIPre-training type=natural language supervised (CLIP), Backbone=ViT-L/14, Pre-trained on external data=true, Evaluation protocol=Clustering2023.03 | 64.5 | 61.8 | 46.8 | |
| TSPEvaluation protocol=Clustering2023.03 | 61.4 | 55.6 | 43.3 | |
| ProPosEvaluation protocol=Clustering, Includes additional dataset splits during training=true2023.03 | 60.6 | 61.4 | 45.1 | |
| TEMIPre-training type=MSN, Backbone=ViT-L/16, Pre-trained on external data=true, Evaluation protocol=Clustering2023.03 | 59.8 | 57.8 | 42.5 | |
| SPICEEvaluation protocol=Clustering2023.03 | 56.7 | 53.8 | 38.7 | |
| PCLEvaluation protocol=Clustering2023.03 | 52.8 | 52.6 | 36.3 | |
| SCANEvaluation protocol=Clustering2023.03 | 48.6 | 50.7 | 33.3 | |
| NNMEvaluation protocol=Clustering2023.03 | 48.4 | 47.7 | 31.6 | |
| PICAEvaluation protocol=Clustering2023.03 | 31 | 33.7 | 17.1 | |
| DCCMEvaluation protocol=Clustering2023.03 | 28.5 | 32.7 | 17.3 | |
| DACEvaluation protocol=Clustering2023.03 | 18.5 | 23.8 | 8.8 |