Compositionality Evaluation on CREPE
92.6CUMosaiCLIP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MosaiCLIPArch.=RN-50, Pre-training data=CC-12M2023.05 | 92.6 | 44.4 | |
| MosaiCLIPArch.=Swin-T, Pre-training data=CC-12M2023.05 | 92.1 | 44.5 | |
| MosaiCLIPArch.=RN-50, Pre-training data=YFCC-15M2023.05 | 90.2 | 45 | |
| MosaiCLIPArch.=Swin-T, Pre-training data=YFCC-15M2023.05 | 89.6 | 45.3 | |
| NegCLIPArch.=RN-50, Pre-training data=CC-12M2023.05 | 82 | 41.4 | |
| NegCLIPArch.=Swin-T, Pre-training data=CC-12M2023.05 | 80.3 | 39.6 | |
| NegCLIPArch.=RN-50, Pre-training data=YFCC-15M2023.05 | 67.2 | 41.5 | |
| NegCLIPArch.=Swin-T, Pre-training data=YFCC-15M2023.05 | 47.1 | 41.5 | |
| CLIPArch.=Swin-T, Pre-training data=CC-12M2023.05 | 44.1 | 37.3 | |
| CLIPArch.=RN-50, Pre-training data=CC-12M2023.05 | 42.9 | 36.7 | |
| CLIPArch.=Swin-T, Pre-training data=YFCC-15M2023.05 | 39.6 | 41.7 | |
| CLIPArch.=RN-50, Pre-training data=YFCC-15M2023.05 | 38.9 | 38.9 | |
| RandomPre-training data=CC-12M2023.05 | 14.3 | 20 | |
| RandomPre-training data=YFCC-15M2023.05 | 14.3 | 20 |