Multimodal Embedding Evaluation on MMEB Overall
72.6Classification ScoreAGFF-EMBED
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AGFF-EMBEDSize=7B2026.02 | 72.6 | 72.6 | 73.8 | 90 | 79.5 | 69.1 | 74.9 | |
| B3Size=7B2026.02 | 70 | 66.5 | 74.1 | 84.6 | 75.9 | 67.1 | 72 | |
| QQMMSize=7B2026.02 | 69.9 | 70 | 72.1 | 86 | 77.2 | 66.6 | 72.5 | |
| UME-R1Size=7B2026.02 | 67.1 | 69.2 | 71.9 | 84.9 | 76.1 | 65.1 | 71.3 | |
| UniMESize=7B2026.02 | 66.8 | 66.6 | 70.5 | 90.9 | 74.6 | 65.8 | 70.7 | |
| ReMatchSize=7B2026.02 | 65.8 | 73.6 | 74.1 | 92.5 | 78.1 | 68.2 | 73.7 | |
| LLaVESize=7B2026.02 | 65.7 | 65.4 | 70.9 | 91.9 | 75 | 64.4 | 70.3 | |
| UniME-V2Size=7B2026.02 | 65.3 | 67.6 | 72.9 | 90.2 | 74.8 | 66.7 | 71.2 | |
| VLM2VecSize=7B2026.02 | 61.2 | 49.9 | 67.4 | 86.1 | 67.5 | 57.1 | 62.9 | |
| EVA-CLIPSize=8B2026.02 | 56 | 10.4 | 49.2 | 58.9 | 38.1 | 45.6 | 43.7 | |
| OpenCLIPSize=0.4B2026.02 | 47.8 | 10.9 | 52.3 | 53.3 | 39.3 | 40.2 | 39.7 | |
| UniIR (CLIPSF)Size=unknown2026.02 | 44.3 | 16.2 | 61.8 | 65.3 | 47.1 | 41.7 | 44.7 | |
| CLIPSize=0.4B2026.02 | 42.8 | 9.1 | 53 | 51.8 | 37.1 | 38.7 | 37.8 | |
| UniIR (BLIPFF)Size=unknown2026.02 | 42.1 | 15 | 60.1 | 62.2 | 44.7 | 40.4 | 42.8 | |
| SigLIPSize=0.9B2026.02 | 40.3 | 8.4 | 31.6 | 59.5 | 32.3 | 38 | 34.8 | |
| MagicLensSize=0.4B2026.02 | 38.8 | 8.3 | 35.4 | 26 | 31 | 23.7 | 27.8 | |
| BLIP2Size=1.2B2026.02 | 27 | 4.2 | 33.9 | 47 | 25.3 | 25.1 | 25.2 | |
| E5-VSize=7B2026.02 | 21.8 | 4.9 | 11.5 | 19 | 14.9 | 11.5 | 13.3 |