Zero-shot Image Classification and Retrieval on DataComp small 10M (train)
14.6Average Zero-Shot PerformanceGrad-Mimic
Evaluation results
| Method | Links | |
|---|---|---|
| Grad-MimicMimic Layer=Last MLP Layer in Image Encoder, Temperature=0.052025.01 | 14.6 | |
| Grad-MimicMimic Layer=Last MLP Layer in Image Encoder, Temperature=0.52025.01 | 14.5 | |
| Grad-MimicMimic Layer=Last MLP Layer in Text Encoder, Temperature=0.52025.01 | 13.9 | |
| Grad-MimicMimic Layer=Last MLP Layer in Text Encoder, Temperature=0.052025.01 | 13.5 | |
| Vanilla TrainingMimic Layer=—, Temperature=—2025.01 | 13.1 |