Multimodal Retrieval on MMEB Total v2
68.1Overall ScoreUME-R1
Evaluation Results
| Method | Links | |
|---|---|---|
| UME-R1Backbone=Qwen2-VL, Parameter Scale=7B, Oracle Evaluation Mode=true2025.11 | 68.1 | |
| UME-R1Backbone=Qwen2-VL, Parameter Scale=7B2025.11 | 64.5 | |
| UME-R1Backbone=Qwen2-VL, Parameter Scale=2B, Oracle Evaluation Mode=true2025.11 | 64.4 | |
| CAFeBackbone=LLaVA-OV, Parameter Scale=7B2025.11 | 60.6 | |
| UME-R1Backbone=Qwen2-VL, Parameter Scale=2B2025.11 | 60.1 | |
| VLM2Vec-V2Backbone=Qwen2-VL, Parameter Scale=2B2025.11 | 58 | |
| GMEBackbone=Qwen2-VL, Parameter Scale=7B2025.11 | 57.8 | |
| DUMEBackbone=Qwen2-VL, Parameter Scale=7B2025.11 | 55.9 | |
| GMEBackbone=Qwen2-VL, Parameter Scale=2B2025.11 | 54.1 | |
| DUMEBackbone=Qwen2-VL, Parameter Scale=2B2025.11 | 52.7 | |
| VLM2VecBackbone=Qwen2-VL, Parameter Scale=7B2025.11 | 52.3 | |
| LamRABackbone=Qwen2.5-VL, Parameter Scale=7B2025.11 | 47.4 | |
| VLM2VecBackbone=Qwen2-VL, Parameter Scale=2B2025.11 | 47 | |
| ColPali-V1.3Backbone=PaliGemma, Parameter Scale=3B2025.11 | 44.4 | |
| LamRABackbone=Qwen2-VL, Parameter Scale=7B2025.11 | 40.4 |