List your company
ResearchFormerly WizWand

Multimodal Retrieval on MMEB Total v2

68.1Overall ScoreUME-R1
39.29246.77154.2561.729Nov 1, 2025
Updated 8mo ago

Evaluation results

MethodLinks
UME-R1Backbone=Qwen2-VL, Parameter Scale=7B, Oracle Evaluation Mode=true2025.1168.1
UME-R1Backbone=Qwen2-VL, Parameter Scale=7B2025.1164.5
UME-R1Backbone=Qwen2-VL, Parameter Scale=2B, Oracle Evaluation Mode=true2025.1164.4
CAFeBackbone=LLaVA-OV, Parameter Scale=7B2025.1160.6
UME-R1Backbone=Qwen2-VL, Parameter Scale=2B2025.1160.1
VLM2Vec-V2Backbone=Qwen2-VL, Parameter Scale=2B2025.1158
GMEBackbone=Qwen2-VL, Parameter Scale=7B2025.1157.8
DUMEBackbone=Qwen2-VL, Parameter Scale=7B2025.1155.9
GMEBackbone=Qwen2-VL, Parameter Scale=2B2025.1154.1
DUMEBackbone=Qwen2-VL, Parameter Scale=2B2025.1152.7
VLM2VecBackbone=Qwen2-VL, Parameter Scale=7B2025.1152.3
LamRABackbone=Qwen2.5-VL, Parameter Scale=7B2025.1147.4
VLM2VecBackbone=Qwen2-VL, Parameter Scale=2B2025.1147
ColPali-V1.3Backbone=PaliGemma, Parameter Scale=3B2025.1144.4
LamRABackbone=Qwen2-VL, Parameter Scale=7B2025.1140.4