Multimodal Visual Document Retrieval on MMEB Visual Document portion v2
89.44ViDoRe V1 Scoregme-Qwen2-VL-7B-Instruct
Evaluation results
| Method | Links | ||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| gme-Qwen2-VL-7B-InstructSize (B)=8.32026.03 | 89.44 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 55.61 | 84.99 | 44.4 | 75.18 | — | — | — | — | — | |
| GMEBackbone=Qwen2-VL, Parameter Scale=7B2025.11 | 89.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 55.6 | 85 | 44.4 | 75.2 | — | — | — | — | — | |
| Evo-Retriever-7BSize (B)=7.02026.03 | 89.35 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 61.41 | 89.28 | 44 | 77.12 | — | — | — | — | — | |
| Evo-Retriever-3BSize (B)=3.02026.03 | 88.14 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 58.64 | 89.06 | 42.84 | 75.91 | — | — | — | — | — | |
| gme-Qwen2-VL-2B-InstructSize (B)=2.22026.03 | 86.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 53.96 | 82.52 | 43.12 | 72.71 | — | — | — | — | — | |
| GMEBackbone=Qwen2-VL, Parameter Scale=2B2025.11 | 86.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 54 | 82.5 | 43.1 | 72.7 | — | — | — | — | — | |
| GMEVenue=CVPR’25, Backbone=Qwen2-VL-2B2026.04 | 86.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 54 | 82.5 | 43.1 | 72.7 | — | — | — | — | — | |
| Seed-1.6-embeddingSize (B)=-2026.03 | 85.53 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 56.57 | 84.74 | 43.14 | 73.44 | — | — | — | — | — | |
| ColPali-V1.3Backbone=PaliGemma, Parameter Scale=3B2025.11 | 83.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 52 | 81.1 | 43.1 | 71 | — | — | — | — | — | |
| colpali-v1.3Size (B)=2.92026.03 | 83.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 51.98 | 81.13 | 43.12 | 70.97 | — | — | — | — | — | |
| Ops-MM-embedding-v1-7BSize (B)=8.32026.03 | 80.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 59.59 | 79.32 | 43.34 | 70.34 | — | — | — | — | — | |
| UME-R1Backbone=Qwen2-VL, Parameter Scale=7B, Oracle Evaluation Mode=true2025.11 | 79.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 55.8 | 86 | 40.7 | 70.8 | — | — | — | — | — | |
| UME-R1Backbone=Qwen2-VL, Parameter Scale=2B, Oracle Evaluation Mode=true2025.11 | 76.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 51.5 | 82.6 | 41.5 | 68.2 | — | — | — | — | — | |
| Ops-MM-embedding-v1-2BSize (B)=2.22026.03 | 76.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 53.18 | 77.64 | 41.17 | 66.96 | — | — | — | — | — | |
| UME-R1Backbone=Qwen2-VL, Parameter Scale=7B2025.11 | 75.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 50.5 | 83.7 | 37.6 | 67.1 | — | — | — | — | — | |
| VLM2Vec-V2.0-Qwen2VL-2BSize (B)=2.22026.03 | 75.52 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 44.86 | 79.38 | 39.43 | 65.36 | — | — | — | — | — | |
| VLM2Vec-V2Backbone=Qwen2-VL, Parameter Scale=2B2025.11 | 75.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 44.9 | 79.4 | 39.4 | 65.4 | — | — | — | — | — | |
| VLM2Vec-V2Venue=TMLR’26, Backbone=Qwen2-VL-2B2026.04 | 75.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 44.9 | 79.4 | 39.4 | 65.4 | — | — | — | — | — | |
| UME-R1Backbone=Qwen2-VL, Parameter Scale=2B2025.11 | 72.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 46.2 | 79.2 | 37.2 | 63.9 | — | — | — | — | — | |
| UME-R1Venue=ICLR’26, Backbone=Qwen2-VL-2B2026.04 | 72.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 46.2 | 79.2 | 37.2 | 63.9 | — | — | — | — | — | |
| PLUMEVenue=Ours, Backbone=Qwen2-VL-2B2026.04 | 72.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 49.8 | 78.1 | 57.4 | 67.5 | — | — | — | — | — | |
| CAFeBackbone=LLaVA-OV, Parameter Scale=7B2025.11 | 70.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 49.6 | 79.5 | 38.1 | 63.9 | — | — | — | — | — | |
| DUMEBackbone=Qwen2-VL, Parameter Scale=2B2025.11 | 67.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 43.3 | 47.1 | 33.8 | 52.8 | — | — | — | — | — | |
| DUMEVenue=ICLR’26, Backbone=Qwen2-VL-2B2026.04 | 67.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 43.3 | 47.1 | 33.8 | 52.8 | — | — | — | — | — | |
| DUMEBackbone=Qwen2-VL, Parameter Scale=7B2025.11 | 67.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 35.2 | 82.6 | 34.9 | 60.3 | — | — | — | — | — | |
| VLM2VecBackbone=Qwen2-VL, Parameter Scale=7B2025.11 | 56.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 9.4 | 59.1 | 38.1 | 46.4 | — | — | — | — | — | |
| LamRABackbone=Qwen2.5-VL, Parameter Scale=7B2025.11 | 56.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 33.3 | 58.2 | 40.1 | 50.2 | — | — | — | — | — | |
| VLM2VecBackbone=Qwen2-VL, Parameter Scale=2B2025.11 | 49.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 13.5 | 51.8 | 33.5 | 41.6 | — | — | — | — | — | |
| VLM2VecVenue=ICLR’25, Backbone=Qwen2-VL-2B2026.04 | 49.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 13.5 | 51.8 | 33.5 | 41.6 | — | — | — | — | — | |
| LamRABackbone=Qwen2-VL, Parameter Scale=7B2025.11 | 22 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 11.5 | 37.4 | 21 | 23.9 | — | — | — | — | — | |
| LamRAVenue=CVPR’25, Backbone=Qwen2-VL-2B2026.04 | 22 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 11.5 | 37.4 | 21 | 23.9 | — | — | — | — | — | |
| CAFeBackbone=LLaVA-OV, Model Size Group=~ 7B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.7 | 49.6 | 79.5 | 38.1 | 63.9 | |
| CAFe-7BModel Scale=7B2026.02 | — | 73.3 | 38.3 | 80.6 | 80.7 | 37.8 | 52 | 86 | 84.8 | 85 | 88.4 | 50.7 | 50.9 | 54.3 | 42.3 | 74 | 82.7 | 75.1 | 87.6 | 87.9 | 69.4 | 22.5 | 73.8 | 13.3 | 42.6 | — | — | — | — | — | — | — | — | — | |
| ColPali v1.3version=v1.32026.02 | — | 81.7 | 56.6 | 84.9 | 86.9 | 70.9 | 75.1 | 95.7 | 94.7 | 93.6 | 95.9 | 51.3 | 54.7 | 49 | 52.9 | 80.9 | 72.3 | 82 | 85.1 | 83.5 | 79.3 | 38.1 | 87.5 | 27.1 | 80.4 | — | — | — | — | — | — | — | — | — | |
| ColPali-V1.3Backbone=PaliGemma, Model Size Group=~ 2B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.6 | 52 | 81.1 | 43.1 | 71 | |
| DUMEBackbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.6 | 43.3 | 47.1 | 33.8 | 52.8 | |
| DUMEBackbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.1 | 35.2 | 82.6 | 34.9 | 60.3 | |
| Embed-RLModel Scale=2B2026.02 | — | 86.1 | 45.7 | 86.8 | 94.5 | 54.6 | 70.7 | 94 | 86.7 | 89 | 91.1 | 56.9 | 51 | 53 | 46.9 | 84.9 | 88.3 | 79.1 | 92.3 | 90 | 73 | 82 | 82.6 | 47.7 | 50.3 | — | — | — | — | — | — | — | — | — | |
| Embed-RLModel Scale=4B2026.02 | — | 88.7 | 47.5 | 86.9 | 94.7 | 54.8 | 69 | 91.6 | 88.1 | 90.7 | 90.4 | 59.8 | 50.1 | 53.9 | 49.7 | 86.9 | 88.5 | 79.3 | 92.6 | 89.6 | 72.4 | 84.4 | 82.4 | 51 | 50.7 | — | — | — | — | — | — | — | — | — | |
| GMEBackbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 86.1 | 54 | 82.5 | 43.1 | 72.7 | |
| GMEBackbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 89.4 | 55.6 | 85 | 44.4 | 75.2 | |
| GME-7BModel Scale=7B2026.02 | — | 86.9 | 57.5 | 91.6 | 94.6 | 74.1 | 96.8 | 99.6 | 95.3 | 98.8 | 99.3 | 63.4 | 49.5 | 54.2 | 55.4 | 87.4 | 86.1 | 89.7 | 92.6 | 88.6 | 76.5 | 32.6 | 90.3 | 36.9 | 85.2 | — | — | — | — | — | — | — | — | — | |
| LamRABackbone=Qwen2.5-VL, Model Size Group=~ 7B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 56.3 | 33.3 | 58.2 | 40.1 | 50.2 | |
| Ops-MM-EmbedBackbone=Qwen2-VL, Data Access Setting=Closed-Source or w/ Additional Data2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.1 | 59.6 | 79.3 | 67.8 | 74.4 | |
| Qwen3-VL-EmbeddingBackbone=Qwen3-VL, Data Access Setting=Closed-Source or w/ Additional Data2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 87.2 | 69.9 | 88.7 | 73.3 | 82.4 | |
| RIMEBackbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.4 | 51.4 | 81.7 | 63.9 | 71.4 | |
| RIMEBackbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.9 | 55.6 | 85.8 | 66.9 | 75.6 | |
| Seed-1.6-embeddingBackbone=Seed1.6-flash, Data Access Setting=Closed-Source or w/ Additional Data2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 85.5 | 56.6 | 84.7 | 43.1 | 73.4 | |
| Think-Then-EmbedBackbone=Qwen2-VL, Data Access Setting=Closed-Source or w/ Additional Data2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 84.1 | 62.7 | 91.9 | 47.6 | 76.4 | |
| UME-R1Backbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 72.4 | 46.2 | 79.2 | 37.2 | 63.9 | |
| UME-R1Backbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.7 | 50.5 | 83.7 | 37.6 | 67.1 | |
| UME-R1-2BModel Scale=2B2026.02 | — | 73.9 | 37.9 | 76.2 | 86.1 | 40.6 | 66.8 | 85.9 | 83.3 | 82.6 | 90.8 | 50.2 | 46.2 | 45.7 | 42.7 | 74.3 | 86 | 75.6 | 87.1 | 84.4 | 68 | 21.2 | 75.9 | 11.9 | 39.7 | — | — | — | — | — | — | — | — | — | |
| UME-R1-7BModel Scale=7B2026.02 | — | 73.6 | 41.1 | 80.8 | 90.2 | 46.7 | 65 | 89.5 | 85.7 | 89.8 | 94.3 | 50.4 | 50.7 | 57.8 | 43.2 | 80.5 | 85 | 83.4 | 91.5 | 89.2 | 72.7 | 21.3 | 75.3 | 12.3 | 41.3 | — | — | — | — | — | — | — | — | — | |
| VLM2VecBackbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 49.8 | 13.5 | 51.8 | 33.5 | 41.6 | |
| VLM2VecBackbone=Qwen2-VL, Model Size Group=~ 7B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 56.9 | 9.4 | 59.1 | 38.1 | 46.4 | |
| VLM2Vec-7BModel Scale=7B2026.02 | — | 60.2 | 34.7 | 70.4 | 78.2 | 27.6 | 38.6 | 67.7 | 60.4 | 61.8 | 69.9 | 6.8 | 5.1 | 13.9 | 11.9 | 52.6 | 57.7 | 60.6 | 54.7 | 66 | 62.7 | 16.3 | 69.4 | 0.4 | 28.8 | — | — | — | — | — | — | — | — | — | |
| VLM2Vec-V2Backbone=Qwen2-VL, Model Size Group=~ 2B Model Size2026.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.5 | 44.9 | 79.4 | 39.4 | 65.4 | |
| VLM2Vec-V2-2BModel Scale=2B2026.02 | — | 80.6 | 44.9 | 83.7 | 89.2 | 43.8 | 60.8 | 88.5 | 86.5 | 85 | 92.2 | 45.6 | 44.3 | 43 | 46.6 | 76.9 | 83.7 | 88.1 | 84.1 | 82.3 | 75.9 | 29.1 | 79 | 15.8 | 63 | — | — | — | — | — | — | — | — | — |