Multi-modal Retrieval (Text Query) on MMQA
87.17Recall@20Cohere Embed 3
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Cohere Embed 3Scoring Method=Cos2025.11 | 87.17 | 78.81 | 74.72 | |
| E5-VScoring Method=Cos2025.11 | 84.88 | 66.67 | 67.2 | |
| E5-VScoring Method=Std2025.11 | 80.79 | 63.33 | 63.56 | |
| Cohere Embed 3Scoring Method=Ours2025.11 | 73.99 | 63.25 | 59.2 | |
| Cohere Embed 3Scoring Method=Std2025.11 | 72.19 | 66.33 | 60.63 | |
| E5-VScoring Method=Ours2025.11 | 70.39 | 53.15 | 53.12 | |
| Long-CLIP-LScoring Method=Cos2025.11 | 63.04 | 45.56 | 44.32 | |
| Long-CLIP-BScoring Method=Cos2025.11 | 58.67 | 45.11 | 43.02 | |
| Long-CLIP-LScoring Method=Std2025.11 | 58.39 | 41.94 | 40.7 | |
| Long-CLIP-LScoring Method=Ours2025.11 | 57.07 | 38.6 | 38.19 | |
| Long-CLIP-BScoring Method=Std2025.11 | 54.65 | 40.73 | 38.76 | |
| Long-CLIP-BScoring Method=Ours2025.11 | 53.33 | 35.48 | 35.04 | |
| BLIPScoring Method=Cos2025.11 | 41.75 | 30.2 | 28.64 | |
| BLIPScoring Method=Std2025.11 | 40.92 | 28.58 | 27.42 | |
| BLIPScoring Method=Ours2025.11 | 36.75 | 23.33 | 23.31 | |
| CLIP (ViT-L/14)Scoring Method=Cos2025.11 | 35.51 | 28.63 | 25.86 | |
| CLIP (ViT-L/14)Scoring Method=Std2025.11 | 35.37 | 27.6 | 25.16 | |
| CLIP (ViT-B/32)Scoring Method=Cos2025.11 | 31.9 | 26.62 | 23.9 | |
| CLIP (ViT-B/32)Scoring Method=Std2025.11 | 31.55 | 25.78 | 23.25 | |
| CLIP (ViT-L/14)Scoring Method=Ours2025.11 | 31.28 | 21.48 | 20.54 | |
| CLIP (ViT-B/32)Scoring Method=Ours2025.11 | 27.46 | 18.44 | 17.88 |