Multimodal Retrieval on M-BEIR extended (test)
32.1Recall (I→I)MMEmbed
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MMEmbedLLM Size=7B2026.03 | 32.1 | 96.7 | 49.9 | 44.2 | — | — | — | — | 77.2 | 47.2 | 38.5 | 68.5 | — | |
| PE-CoreLLM Size=-2026.03 | 32 | 56.8 | 58 | 53.4 | 32.3 | 29.5 | — | — | — | — | — | — | — | |
| VLM2VecV2LLM Size=1.5B2026.03 | 30 | 81.1 | 43.4 | 39.8 | 17.6 | 18.4 | — | — | 61.6 | 24.5 | 28.7 | 33.6 | 76.4 | |
| CLIP_SFLLM Size=-2026.03 | 28.4 | 83.7 | 50 | 45.1 | — | — | — | — | 63.6 | 41 | 26.4 | 60.6 | — | |
| CLIPLLM Size=-2026.03 | 25.9 | 40.5 | 43.1 | 37.5 | 14.2 | 15.9 | — | — | — | — | — | — | — | |
| SigLIPLLM Size=-2026.03 | 25.9 | 34 | 56.5 | 52.1 | 19.7 | 22.5 | — | — | — | — | — | — | — | |
| OmniRetLLM Size=1.5B2026.03 | 24.4 | 86.7 | 50.6 | 46.9 | 43.8 | 43.2 | 66.8 | 62.4 | 70.5 | 44.4 | 36.5 | 64.8 | 86.2 | |
| CLAPLLM Size=-2026.03 | — | — | — | — | — | — | 63.9 | 56.6 | — | — | — | — | — | |
| MMTLLM Size=-2026.03 | — | — | — | — | — | — | 49.8 | 46.8 | — | — | — | — | — |