Multi-modal Retrieval (Image Query) on MMQA
76.52Recall@20CLIP (ViT-L/14)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CLIP (ViT-L/14)Scoring Method=Ours2025.11 | 76.52 | 58.88 | 63.05 | |
| Long-CLIP-LScoring Method=Ours2025.11 | 73.91 | 54.04 | 58.63 | |
| Long-CLIP-LScoring Method=Std2025.11 | 71.74 | 49.38 | 54.52 | |
| Long-CLIP-BScoring Method=Ours2025.11 | 66.96 | 50.72 | 54.51 | |
| CLIP (ViT-B/32)Scoring Method=Ours2025.11 | 66.09 | 45.03 | 49.86 | |
| Long-CLIP-BScoring Method=Std2025.11 | 66.09 | 47.67 | 51.94 | |
| CLIP (ViT-L/14)Scoring Method=Std2025.11 | 62.17 | 43.32 | 47.7 | |
| CLIP (ViT-B/32)Scoring Method=Std2025.11 | 52.61 | 36.65 | 40.32 | |
| Cohere Embed 3Scoring Method=Std2025.11 | 52.17 | 27.24 | 32.92 | |
| Cohere Embed 3Scoring Method=Ours2025.11 | 52.17 | 28.17 | 33.61 | |
| Cohere Embed 3Scoring Method=Cos2025.11 | 50.43 | 20.79 | 27.61 | |
| BLIPScoring Method=Ours2025.11 | 43.48 | 27.45 | 31.15 | |
| E5-VScoring Method=Std2025.11 | 41.74 | 21.33 | 25.91 | |
| E5-VScoring Method=Ours2025.11 | 41.74 | 21.55 | 26.09 | |
| BLIPScoring Method=Std2025.11 | 39.57 | 23.97 | 27.54 | |
| E5-VScoring Method=Cos2025.11 | 38.7 | 17.34 | 22.06 | |
| CLIP (ViT-L/14)Scoring Method=Cos2025.11 | 1.3 | 0.41 | 0.62 | |
| Long-CLIP-LScoring Method=Cos2025.11 | 0.43 | 0.11 | 0.19 | |
| CLIP (ViT-B/32)Scoring Method=Cos2025.11 | 0 | 0 | 0 | |
| Long-CLIP-BScoring Method=Cos2025.11 | 0 | 0 | 0 | |
| BLIPScoring Method=Cos2025.11 | 0 | 0 | 0 |