Multimodal Ranking on MMEB
70Classification ScoreB3-7B
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| B3-7B# Params=7B, Setting=Fine-tuning on MMEB (≥ 7B Models)2026.02 | 70 | 66.5 | 74.1 | 84.6 | 75.9 | 67.1 | 72 | |
| MuCo-7B# Params=7B, Setting=Fine-tuning on MMEB (≥ 7B Models)2026.02 | 68.3 | 71.9 | 73.7 | 90.9 | 77.3 | 69.1 | 73.6 | |
| mmE5# Params=11B, Setting=Fine-tuning on MMEB (≥ 7B Models)2026.02 | 67.6 | 62.7 | 71 | 89.7 | 72.4 | 66.6 | 69.8 | |
| B3-2B# Params=2B, Setting=Fine-tuning on MMEB (< 7B Models)2026.02 | 67 | 61.2 | 70.9 | 79.9 | 72.1 | 63.1 | 68.1 | |
| UniME# Params=7B, Setting=Fine-tuning on MMEB (≥ 7B Models)2026.02 | 66.8 | 66.6 | 70.6 | 90.9 | 74.6 | 65.8 | 70.7 | |
| MuCo-2B# Params=2B, Setting=Fine-tuning on MMEB (< 7B Models)2026.02 | 66.2 | 65.6 | 70.1 | 85.8 | 72.9 | 65 | 69.5 | |
| MoCa-7B# Params=7B, Setting=Fine-tuning on MMEB (≥ 7B Models)2026.02 | 65.8 | 64.7 | 75 | 92.4 | 74.7 | 67.6 | 71.5 | |
| LLaVE# Params=7B, Setting=Fine-tuning on MMEB (≥ 7B Models)2026.02 | 65.7 | 65.4 | 70.9 | 91.9 | 75 | 64.4 | 70.3 | |
| LLaVE# Params=2B, Setting=Fine-tuning on MMEB (< 7B Models)2026.02 | 62.1 | 60.2 | 65.2 | 84.9 | 69.4 | 59.8 | 65.2 | |
| VLM2Vec# Params=7B, Setting=Fine-tuning on MMEB (≥ 7B Models)2026.02 | 61.2 | 49.9 | 67.4 | 86.1 | 67.5 | 57.1 | 62.9 | |
| mmE5# Params=11B, Setting=Zeroshot setting (pretrained)2026.02 | 60.6 | 55.7 | 54.7 | 72.4 | — | — | 58.6 | |
| MoCa-3B# Params=3B, Setting=Fine-tuning on MMEB (< 7B Models)2026.02 | 59.8 | 62.9 | 70.6 | 88.6 | 72.3 | 61.5 | 67.5 | |
| MuCo-7B# Params=7B, Setting=Zeroshot setting (pretrained)2026.02 | 56 | 64.7 | 58.9 | 75.7 | — | — | 61.6 | |
| MMRet# Params=7B, Setting=Fine-tuning on MMEB (≥ 7B Models)2026.02 | 56 | 57.4 | 69.9 | 83.6 | 68 | 59.1 | 64.1 | |
| CLIP# Params=0.4B, Setting=Fine-tuning on MMEB (< 7B Models)2026.02 | 55.2 | 19.7 | 53.2 | 62.2 | 47.6 | 42.8 | 45.4 | |
| VLM2Vec# Params=4B, Setting=Fine-tuning on MMEB (< 7B Models)2026.02 | 54.8 | 54.9 | 62.3 | 79.5 | 66.5 | 52 | 60.1 | |
| UniME# Params=4B, Setting=Fine-tuning on MMEB (< 7B Models)2026.02 | 54.8 | 55.9 | 64.5 | 81.8 | 68.2 | 52.7 | 64.2 | |
| MuCo-2B# Params=2B, Setting=Zeroshot setting (pretrained)2026.02 | 53.6 | 59.9 | 55.2 | 74.6 | — | — | 58.2 | |
| MMRet# Params=7B, Setting=Zeroshot setting (pretrained)2026.02 | 47.2 | 18.4 | 56.5 | 62.2 | — | — | 44 | |
| CLIP# Params=0.4B, Setting=Zeroshot setting (pretrained)2026.02 | 42.8 | 9.1 | 53 | 51.8 | — | — | 37.8 | |
| MagicLens# Params=0.6B, Setting=Zeroshot setting (pretrained)2026.02 | 38.8 | 8.3 | 35.4 | 26 | — | — | 27.8 | |
| E5-V# Params=8B, Setting=Zeroshot setting (pretrained)2026.02 | 21.8 | 4.9 | 11.5 | 19 | — | — | 13.3 |