Multimodal Retrieval on MMEB v1 (test)
61.2ClassificationVLM2VEC-7B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VLM2VEC-7BFine-tuning setting=MMEB-train2026.04 | 61.2 | 49.9 | 67.4 | 86.1 | 67.5 | 57.1 | 62.9 | |
| SLQBackbone size=8B, Fine-tuning setting=MMEB-train2026.04 | 60.9 | 61.2 | 70.5 | 86.6 | 69.4 | 61.7 | 67.5 | |
| UniME-7BFine-tuning setting=MMEB-train2026.04 | 60.6 | 52.9 | 67.9 | 85.1 | 68.4 | 57.9 | 66.6 | |
| IDMR-8BFine-tuning setting=MMEB-train2026.04 | 58.3 | 58.6 | 68.7 | 85.6 | 70.5 | 57.9 | 64.9 | |
| GME-7B2026.04 | 57.6 | 34.6 | 71.2 | 59.5 | — | — | 55.9 | |
| MMRet-7BFine-tuning setting=MMEB-train2026.04 | 56 | 57.4 | 69.9 | 83.6 | 68 | 59.1 | 64.1 | |
| SLQBackbone size=4B, Fine-tuning setting=MMEB-train2026.04 | 55.7 | 58.7 | 65.4 | 84.2 | 66.5 | 58.6 | 64.5 | |
| SLQBackbone size=2B, Fine-tuning setting=MMEB-train2026.04 | 54.2 | 53.3 | 62.1 | 79.5 | 62.3 | 56 | 59.6 | |
| SLQBackbone size=1B, Fine-tuning setting=MMEB-train2026.04 | 52.5 | 49.1 | 60.2 | 78.3 | 59.8 | 54.5 | 57.3 | |
| MM-Embed-8B2026.04 | 48.1 | 32.3 | 63.8 | 57.8 | — | — | 50 | |
| SLQBackbone size=8B, Fine-tuning setting=COCO2026.04 | 41.1 | 10.5 | 47.6 | 59.7 | 37.8 | 35.5 | 36.8 | |
| SigLIP2026.04 | 40.3 | 8.4 | 31.6 | 59.5 | 32.3 | 38 | 34.8 | |
| MagiLens2026.04 | 38.8 | 8.3 | 35.4 | 26 | 33.1 | 23.7 | 27.8 | |
| SLQBackbone size=4B, Fine-tuning setting=COCO2026.04 | 35.4 | 11.3 | 43.7 | 56.2 | 34.5 | 32.6 | 33.9 | |
| SLQBackbone size=1B, Fine-tuning setting=COCO2026.04 | 33.9 | 11 | 35 | 53.5 | 30.8 | 29.1 | 30.1 | |
| SLQBackbone size=2B, Fine-tuning setting=COCO2026.04 | 33.6 | 10.7 | 39.2 | 55.4 | 32 | 30.6 | 31.4 | |
| BLIP22026.04 | 27 | 4.2 | 33.9 | 47 | 25.3 | 25.1 | 25.2 | |
| E5-V-7B2026.04 | 21.8 | 4.9 | 11.5 | 19 | 14.9 | 11.5 | 13.3 |