Multimodal Retrieval on MRMR
79.3Score (Art Domain)Ops-MM-Embed
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ops-MM-EmbedBackbone=Qwen2-VL, Size=7B2026.04 | 79.3 | 48.1 | 52.5 | 70 | 67.8 | 27.7 | 39.5 | 30.1 | 52.3 | 8 | 55.9 | 45.8 | |
| Ops-MM-EmbedBackbone=Qwen2-VL, Size=7B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 79.3 | 48.1 | 52.5 | 70 | 67.8 | 27.7 | 39.5 | 30.1 | 52.3 | 8 | 55.9 | 45.8 | |
| UME-R1Backbone=Qwen2-VL, Size=7B2026.04 | 77.8 | 48 | 55.7 | 72.9 | 64.1 | 27.2 | 39.2 | 32.2 | 47.8 | 7.5 | 61.9 | 41.7 | |
| UME-R1Backbone=Qwen2-VL, Size=7B, Reasoning Category=Explicit Reasoning2026.06 | 77.8 | 48 | 55.7 | 72.9 | 64.1 | 27.2 | 39.2 | 32.2 | 47.8 | 7.5 | 61.9 | 41.7 | |
| RIMEBackbone=Qwen2-VL, Size=7B2026.04 | 76.8 | 50.2 | 58.5 | 73.6 | 71.4 | 29.2 | 43 | 35.6 | 51.8 | 8.5 | 64.1 | 39.5 | |
| RIMEBackbone=Qwen2-VL, Size=7B, Reasoning Category=Explicit Reasoning2026.06 | 76.8 | 50.2 | 58.5 | 73.6 | 71.4 | 29.2 | 43 | 35.6 | 51.8 | 8.5 | 64.1 | 39.5 | |
| LaMEBackbone=Qwen2-VL, Size=7B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 73.4 | 49.8 | 58.2 | 73.8 | 65.6 | 29.5 | 44.4 | 36.4 | 52.2 | 8.5 | 64.9 | 40.9 | |
| MM-EmbedBackbone=NV-Embed, Size=8B2026.04 | 65.6 | 39.8 | 53 | 63.5 | 62.8 | 23.6 | 30.8 | 27.4 | 44.9 | 7 | 23.8 | 34.9 | |
| MM-EmbedBackbone=NV-Embed, Size=8B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 65.6 | 39.8 | 53 | 63.5 | 62.8 | 23.6 | 30.8 | 27.4 | 44.9 | 7 | 23.8 | 34.9 | |
| OpenCLIPBackbone=ViT-G/14, Size=1B2026.04 | 56 | 17.3 | 17.9 | 33.2 | 22 | 5.7 | 5 | 7 | 9.7 | 13 | 8.1 | 12.4 | |
| OpenCLIPBackbone=ViT-G/14, Size=1B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 56 | 17.3 | 17.9 | 33.2 | 22 | 5.7 | 5 | 7 | 9.7 | 13 | 8.1 | 12.4 | |
| GMEBackbone=Qwen2-VL, Size=7B2026.04 | 54.3 | 36.2 | 40.1 | 46.8 | 45.6 | 28.8 | 36 | 30.2 | 45.1 | 15 | 26.3 | 29.6 | |
| GMEBackbone=Qwen2-VL, Size=7B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 54.3 | 36.2 | 40.1 | 46.8 | 45.6 | 28.8 | 36 | 30.2 | 45.1 | 15 | 26.3 | 29.6 | |
| VLM2VecBackbone=Qwen2-VL, Size=7B2026.04 | 53.5 | 18.1 | 22.4 | 36.7 | 24 | 2.1 | 2.8 | 2.8 | 2.9 | 11.5 | 5.6 | 18.3 | |
| VLM2VecBackbone=Qwen2-VL, Size=7B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 53.5 | 18.1 | 22.4 | 36.7 | 24 | 2.1 | 2.8 | 2.8 | 2.9 | 11.5 | 5.6 | 18.3 | |
| ColPaliBackbone=PaliGemma, Size=3B2026.04 | 36.1 | 23.7 | 29.9 | 42.7 | 29.2 | 5.7 | 14.8 | 12 | 24.6 | 28.5 | 19.4 | 18.2 | |
| ColPaliBackbone=PaliGemma, Size=3B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 36.1 | 23.7 | 29.9 | 42.7 | 29.2 | 5.7 | 14.8 | 12 | 24.6 | 28.5 | 19.4 | 18.2 | |
| E5-VBackbone=LLaVA-Next, Size=8B2026.04 | 25.1 | 8.6 | 11.7 | 16.6 | 10.8 | 2.1 | 3.4 | 2.5 | 5.2 | 11.5 | 3.7 | 2.1 | |
| E5-VBackbone=LLaVA-Next, Size=8B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 25.1 | 8.6 | 11.7 | 16.6 | 10.8 | 2.1 | 3.4 | 2.5 | 5.2 | 11.5 | 3.7 | 2.1 | |
| VISTABackbone=Qwen2-VL, Size=2B2026.04 | 21.3 | 20.9 | 27.8 | 32.6 | 17 | 18.8 | 17.1 | 17.3 | 28.6 | 20 | 20.2 | 9.4 | |
| VISTABackbone=Qwen2-VL, Size=2B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 21.3 | 20.9 | 27.8 | 32.6 | 17 | 18.8 | 17.1 | 17.3 | 28.6 | 20 | 20.2 | 9.4 | |
| EVA-CLIPBackbone=EVA-ViT, Size=0.4B2026.04 | 10.2 | 10.8 | 13.5 | 26.1 | 12.9 | 6.2 | 10.5 | 9.3 | 11.7 | 8.5 | 4.4 | 5.4 | |
| EVA-CLIPBackbone=EVA-ViT, Size=0.4B, Reasoning Category=Discriminative UME & Latent Reasoning UME2026.06 | 10.2 | 10.8 | 13.5 | 26.1 | 12.9 | 6.2 | 10.5 | 9.3 | 11.7 | 8.5 | 4.4 | 5.4 |