Universal Multimodal Retrieval on MMEB Full v2 (test)
77.8Overall Average ScoreQwen3-VL-Embedding
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-VL-EmbeddingBackbone=Qwen3-VL, Data Access Setting=Closed-Source or w/ Additional Data2026.04 | 77.8 | |
| Seed-1.6-embeddingBackbone=Seed1.6-flash, Data Access Setting=Closed-Source or w/ Additional Data2026.04 | 71.3 | |
| Ops-MM-EmbedBackbone=Qwen2-VL, Data Access Setting=Closed-Source or w/ Additional Data2026.04 | 68.9 | |
| Think-Then-EmbedBackbone=Qwen2-VL, Data Access Setting=Closed-Source or w/ Additional Data2026.04 | 68.6 | |
| RIMEBackbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | 68.6 | |
| UME-R1Backbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | 64.5 | |
| RIMEBackbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | 64.1 | |
| CAFeBackbone=LLaVA-OV, Model Size Group=~ 7B Model Size2026.04 | 60.6 | |
| UME-R1Backbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | 60.1 | |
| VLM2Vec-V2Backbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | 58 | |
| GMEBackbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | 57.8 | |
| DUMEBackbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | 55.9 | |
| GMEBackbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | 54.1 | |
| DUMEBackbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | 52.7 | |
| VLM2VecBackbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | 52.3 | |
| LamRABackbone=Qwen2.5-VL, Model Size Group=~ 7B Model Size2026.04 | 47.4 | |
| VLM2VecBackbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | 47 | |
| ColPali-V1.3Backbone=PaliGemma, Model Size Group=~ 2B Model Size2026.04 | 44.4 |