Text-to-Image Retrieval on COCO-CN
78.7R@1M2-Encoder
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| M2-EncoderModel Size=10B, Protocol=Zero-shot2024.01 | 78.7 | 96 | 98.7 | — | — | — | |
| M2-EncoderModel Size=1B, Protocol=Zero-shot2024.01 | 75.9 | 95.1 | 98.3 | — | — | — | |
| Wukong_ViT-LBackbone=ViT-L, Evaluation Protocol=Fine-tuned2022.02 | 74 | 94.4 | 98.1 | 88.6 | — | — | |
| M2-EncoderModel Size=0.4B, Protocol=Zero-shot2024.01 | 72.5 | 93.7 | 97.7 | — | — | — | |
| FILIP_ViT-LBackbone=ViT-L, Evaluation Protocol=Fine-tuned2022.02 | 72.2 | 92.4 | 97.2 | 86.5 | — | — | |
| Qwen3-VL-EmbeddingParameters=2B2026.02 | 72.2 | — | — | — | — | — | |
| GMEParameters=7B2026.02 | 71.8 | — | — | — | — | — | |
| CLIP_ViT-LBackbone=ViT-L, Evaluation Protocol=Fine-tuned2022.02 | 70.1 | 92.2 | 96.4 | 86.2 | — | — | |
| UME-R1Parameters=2B2026.02 | 70.1 | — | — | — | — | — | |
| FILIP_Swin-LBackbone=Swin-L, Evaluation Protocol=Fine-tuned2022.02 | 69.9 | 93.3 | 97.6 | 86.7 | — | — | |
| ERNIE-ViL 2.0Setting=Zero-shot2022.09 | 69.6 | 91.2 | 96.9 | — | 86.1 | — | |
| ERNIE-ViL 2.0Protocol=Zero-shot2024.01 | 69.6 | 91.2 | 96.9 | — | — | — | |
| CN-CLIPModel Size=1B, Protocol=Zero-shot2024.01 | 69.2 | 89.9 | 96.1 | — | — | — | |
| CLIP_ViT-BBackbone=ViT-B, Evaluation Protocol=Fine-tuned2022.02 | 68.9 | 93.3 | 97.3 | 86.6 | — | — | |
| ObjEmbedParameters=4B2026.02 | 68.8 | — | — | — | — | — | |
| FG-CLIP2Backbone=ViT-So/162026.02 | 68.1 | — | — | — | — | — | |
| Wukong_ViT-BBackbone=ViT-B, Evaluation Protocol=Fine-tuned2022.02 | 67 | 91.4 | 96.7 | 84.6 | — | — | |
| CLIP_Swin-LBackbone=Swin-L, Evaluation Protocol=Fine-tuned2022.02 | 66.7 | 91.5 | 96.3 | 85.4 | — | — | |
| GMEParameters=2B2026.02 | 66.7 | — | — | — | — | — | |
| ObjEmbedParameters=2B2026.02 | 66.7 | — | — | — | — | — | |
| Wukong_Swin-LBackbone=Swin-L, Evaluation Protocol=Fine-tuned2022.02 | 66 | 92.6 | 97.1 | 85.5 | — | — | |
| MetaCLIP2Backbone=ViT-H/142026.02 | 63.1 | — | — | — | — | — | |
| AltCLIPModel Size=0.8B, Protocol=Zero-shot2024.01 | 61.3 | 86 | 93.2 | — | — | — | |
| VLM2Vec-V2Parameters=2B2026.02 | 60.3 | — | — | — | — | — | |
| CN-CLIPModel Size=0.2B, Protocol=Zero-shot2024.01 | 57 | 84.1 | 93.6 | — | — | — | |
| R2D2Setting=Zero-shot2022.09 | 56.4 | 85 | 93.1 | — | 80.5 | — | |
| R2D2Backbone=ViT-L, Zero-shot=true2022.05 | 56.4 | 85 | 93.1 | — | — | 80.5 | |
| R2D2Model Size=0.4B, Protocol=Zero-shot2024.01 | 56.4 | 85 | 93.1 | — | — | — | |
| FILIP_ViT-BBackbone=ViT-B, Evaluation Protocol=Fine-tuned2022.02 | 56.2 | 86.8 | 94.3 | 76.6 | — | — | |
| TaisuModel Size=0.2B, Protocol=Zero-shot2024.01 | 53.6 | 83.7 | 92.4 | — | — | — | |
| WukongBackbone=ViT-L, Zero-shot=true2022.02 | 53.4 | 80.2 | 90.1 | 75.1 | — | — | |
| WukongSetting=Zero-shot2022.09 | 53.4 | 80.2 | 90.1 | — | 75.1 | — | |
| WukongBackbone=ViT-L, Zero-shot=true2022.05 | 53.4 | 80.2 | 90.1 | — | — | 75.1 | |
| WukongModel Size=0.4B, Protocol=Zero-shot2024.01 | 53.4 | 80.2 | 90.1 | — | — | — | |
| FILIPBackbone=ViT-L, Zero-shot=true2022.02 | 52.7 | 79.9 | 88.6 | 75.2 | — | — | |
| FILIPBackbone=ViT-L, Zero-shot=true2022.05 | 52.7 | 79.9 | 88.6 | — | — | 75.2 | |
| VLM2VecParameters=2B2026.02 | 52.6 | — | — | — | — | — | |
| TaiyiSetting=Zero-shot2022.09 | 51.5 | 81 | 90.4 | — | — | — | |
| SigLIP2Backbone=ViT-So/162026.02 | 50.7 | — | — | — | — | — | |
| FILIPBackbone=Swin-L, Zero-shot=true2022.02 | 50.5 | 79.2 | 88.6 | 72.1 | — | — | |
| WukongBackbone=ViT-B, Zero-shot=true2022.02 | 49.2 | 79.4 | 87.9 | 71.9 | — | — | |
| CLIPBackbone=ViT-B, Zero-shot=true2022.02 | 48.7 | 79.4 | 88.5 | 73 | — | — | |
| CLIPBackbone=ViT-L, Zero-shot=true2022.02 | 48.7 | 76.8 | 86.4 | 72.1 | — | — | |
| CLIPBackbone=ViT-L, Zero-shot=true2022.05 | 48.7 | 76.8 | 86.4 | — | — | 72.1 | |
| CLIPBackbone=Swin-L, Zero-shot=true2022.02 | 46.7 | 78.1 | 87.7 | 71.7 | — | — | |
| WukongBackbone=Swin-L, Zero-shot=true2022.02 | 46.4 | 77 | 87.6 | 70.8 | — | — | |
| FILIPBackbone=ViT-B, Zero-shot=true2022.02 | 37.5 | 68.1 | 83 | 61.8 | — | — | |
| BriVLBackbone=N/A, Zero-shot=true2022.02 | 14.8 | 39 | 54.2 | 37.4 | — | — | |
| BriVLModel Size=1B, Protocol=Zero-shot2024.01 | 14.8 | 39 | 54.2 | — | — | — | |
| M3PSetting=Zero-shot2022.09 | — | — | — | — | 32.3 | — |